Anyone working with Common Core Standards? Need structured data.

Events happening in the community are now at Drupal community events on www.drupal.org.
johnbarclay's picture

I'm working on a drupal project for Individualized Educational Program (IEPs) that relies on our state learning standards. Our state is considering implementing the Common Core State Standards (http://www.corestandards.org/the-standards/) and I need xml, csv, or other structured format besides the pdfs on http://www.corestandards.org to update our drupal module.

Thanks for any help on this.

Comments

To the best of my knowledge

bonobo's picture

To the best of my knowledge they have resisted provided the common core standards in anything that resembles a usable format.

We have considered throwing some time into the data entry required to make them accessible in csv format, but we haven't done it yet.

I expressed my thoughts on this in as succinct a manner as possible here :)

Cheers,

Bill

There's also html at the Common Core website

wgmccallum's picture

See http://www.corestandards.org/the-standards/mathematics

It might be quicker to suck that down and write a script to process it. Or, if not quicker, it would at least be more fun.

Screen Scraping Presents Collaboration Problems

johnbarclay's picture

A simple schema with ids from Common Core would allow developers to work from the same data structure. Screen scraping has each set of developers setting up their own data structure (and updating it as common core changes).

From the licensing (http://www.corestandards.org/commercial-license and http://www.corestandards.org/terms-of-use) it seems that publishing a schema and rdf rich xml-ified version of the document for non commercial use would be permitted and might pre-empt many splintered data structures for this document to evolve. I'm waiting to hear back from common core about their machine readable version before doing so. My state has abopted them, but not implemented them or come up with a timeline for doing so. But I have to offer cost estimates on software migrations.

The html could be screen scraped fairly easily, but there are some problems

  1. the urls don't match the domain ids:

http://www.corestandards.org/the-standards/mathematics/grade-5/operation...
maps to the domain 5.NF which would be something like:
http://www.corestandards.org/the-standards/mathematics/grade-5/NF

  1. The domain ids are absent from the html version of the standards.

  2. the clusters don't have ids and its not clear if a cluster title has the same identity across grades.

  3. the urls are just inconsistent making screen scraping a pain.

- /the-standards/mathematics/hs-number-and-quantity/quantities/
- /the-standards/mathematics/grade-8/geometry/
- /the-standards/mathematics/high-school-geometry/congruence/

johnbarclay's picture

Ohio has a great example of what I'm talking about. Looks like the librarians and IT people hashed out a nice set xml documents, a schema, and even a pdf explaining the Ohio State Identifier code.

See:
http://www.ode.state.oh.us/GD/Templates/Pages/ODE/ODEDetail.aspx?page=3&...

http://www.ode.state.oh.us/GD/DocumentManagement/DocumentDownload.aspx?D...

http://www.ode.state.oh.us/GD/DocumentManagement/DocumentDownload.aspx?D...

Updates?

ambivalent's picture

Has there been any movement on this? Or, alternatively, are there other noteworthy projects, working on the same problem? LearnBoost is offering an XML-ified version (http://www.learnboost.com/common-core/) but XML is foreign enough to me that I wouldn't be able to verify whether they've manged to avoid the scraping issues John mentions.

No movement that I know of

wgmccallum's picture

No movement that I know of ... thanks for the link to learnboost.

I'd recommend starting with what LearnBoost is providing

bonobo's picture

These can be exported into Drupal as taxonomy terms or nodes via the Feeds module.

They have provided a great starting point.

EDIT: and, just FYI, they are distributing the standards via a google spreadsheet, not XML.

johnbarclay's picture

The learnboost spreadsheet is missing some of the data, the markup, and special characters. We also needed 1 common spreadsheet for both sets of standards.

We scraped the screen on the website and did ok, but there were enough inconsistencies in the html that it was simpler start from scratch and cut and paste them into a spreadsheet and export them to xml to parse with php.

We are encapsulating these in a ccssi module for the project we are working on which will likely include the excel and xml versions of the document. And maybe functionality to export to a vocab. We will likely post it here when the main developer is happy with the xml/excel data.

We ended up with one spreadsheet with columns for:
standard_id
document (math or ela)
section_id
anchor (boolean)
super strand/super domain
strand/domain
strand/domain id
grade
cluster
number
letter
advanced (math) boolean
modeling (math) boolean
text (of standard)

preliminary version of CCSSI standards available

gdf's picture

The data John mentions above is available now in Excel spreadsheet form. I would like to get some feedback from interested consumers of the data, before making it public. Please contact me directly if you would like the spreadsheet, using the "Contact" tab on my user link.

Common Core on Excel

ssupahan's picture

I'm new to the website and only got here because of this discussion. I was about to do the cut and paste method to translate the common core standards from .pdf to excel myself if necessary, but I'd love to take a look at yours if possible. How can I do that? Can you write me at ssupahan@mac.com?

CCSSI module submitted

gdf's picture

FYI, I have submitted the "ccssi" module as an official project. I'm new to the CVS submission process so this will probably take a while, and doubtless there will be complaints about the quality of the code as I'm also still adapting to the Drupal coding standards. However, if anyone would like to play with the existing module, in what I would call "early alpha" stage, contact me and I'll ship you a tarball.

Great to see this!

bonobo's picture

I'm looking forward to testing this out -

We'll grab a copy of the latest release from the issue at http://drupal.org/node/1003408

RE coding standards: you could run your module through the coder module, which will catch many coding standards issues: http://drupal.org/project/coder

You could also take a look through the steps at http://groups.drupal.org/node/115554 - these steps will help address many of the issues that could get raised in the cvs review process.

wow, they take "open" seriously around here

gdf's picture

I did not realize that you could see the issue that constitutes my application for CVS access. That certainly makes it trivial to pick up a copy of the module. Let me know what you think.

I did run the module through "coder" and have read the application process guidelines. I suspect it's still going to be a long drawn-out process.

file for math standards available

Nina Koch's picture

Hi Folks,

I have a fairly decent version of a tab-delimited text file for the math standards. I am still working on replacing all of the weird characters with html codes (like theta and pi etc). But if anybody wants to take my version and improve it, feel free.

http://www.arps.org/Curriculum/Mathematics/CommonCore/CommonCore.txt

I recommend keeping the id numbers in the order I have them because they give you the proper presentation order.

I started from an Excel file that I found on a Colorado web site. Not sure now where I found it.

I am working on an interface for being able to search and also so we can upload district curriculum information in association with the standards.

Nina

RDF data for standards

josephc's picture

You could also try using data from the Achievement Standard Network which offers standards data as RDF/XML. See the Common Core standards section. Best of all you get web resolvable URI's and the data is free to use under a Creative Commons attribution license.

commoncore.org

jonmarshall's picture

An update to aaustin's reference, which leads to a 404 page. It appears CommonCore.org changed the URL - http://www.corestandards.org/common-core-state-standards-official-identi...

CSV - GoogleDoc spreadsheet

jonmarshall's picture

Here is a resource for a CSV copy of the standards:
https://docs.google.com/spreadsheet/ccc?key=0ArQGMTQa8JRadE5MWXpyUHNseHF...

CSV from Common Core State Standards web site

jasonh's picture

Adding to an old thread, but ran into it via a Google web search, in case its helpful, the canonical identifiers is available from the Common Core State Standards web site:

http://corestandards.org/assets/E0607_ccss_identifiers.csv

Drupal in Education

Group organizers

Group notifications

This group offers an RSS feed. Or subscribe to these personalized, sitewide feeds: