Posted by johnbarclay on July 7, 2010 at 4:14pm
I'm working on a drupal project for Individualized Educational Program (IEPs) that relies on our state learning standards. Our state is considering implementing the Common Core State Standards (http://www.corestandards.org/the-standards/) and I need xml, csv, or other structured format besides the pdfs on http://www.corestandards.org to update our drupal module.
Thanks for any help on this.
Comments
To the best of my knowledge
To the best of my knowledge they have resisted provided the common core standards in anything that resembles a usable format.
We have considered throwing some time into the data entry required to make them accessible in csv format, but we haven't done it yet.
I expressed my thoughts on this in as succinct a manner as possible here :)
Cheers,
Bill
FunnyMonkey
There's also html at the Common Core website
See http://www.corestandards.org/the-standards/mathematics
It might be quicker to suck that down and write a script to process it. Or, if not quicker, it would at least be more fun.
Screen Scraping Presents Collaboration Problems
A simple schema with ids from Common Core would allow developers to work from the same data structure. Screen scraping has each set of developers setting up their own data structure (and updating it as common core changes).
From the licensing (http://www.corestandards.org/commercial-license and http://www.corestandards.org/terms-of-use) it seems that publishing a schema and rdf rich xml-ified version of the document for non commercial use would be permitted and might pre-empt many splintered data structures for this document to evolve. I'm waiting to hear back from common core about their machine readable version before doing so. My state has abopted them, but not implemented them or come up with a timeline for doing so. But I have to offer cost estimates on software migrations.
The html could be screen scraped fairly easily, but there are some problems
http://www.corestandards.org/the-standards/mathematics/grade-5/operation...
maps to the domain 5.NF which would be something like:
http://www.corestandards.org/the-standards/mathematics/grade-5/NF
The domain ids are absent from the html version of the standards.
the clusters don't have ids and its not clear if a cluster title has the same identity across grades.
the urls are just inconsistent making screen scraping a pain.
- /the-standards/mathematics/hs-number-and-quantity/quantities/
- /the-standards/mathematics/grade-8/geometry/
- /the-standards/mathematics/high-school-geometry/congruence/
www.johnbarclay.com
Good example of a standard with a machine readable version
Ohio has a great example of what I'm talking about. Looks like the librarians and IT people hashed out a nice set xml documents, a schema, and even a pdf explaining the Ohio State Identifier code.
See:
http://www.ode.state.oh.us/GD/Templates/Pages/ODE/ODEDetail.aspx?page=3&...
http://www.ode.state.oh.us/GD/DocumentManagement/DocumentDownload.aspx?D...
http://www.ode.state.oh.us/GD/DocumentManagement/DocumentDownload.aspx?D...
www.johnbarclay.com
Updates?
Has there been any movement on this? Or, alternatively, are there other noteworthy projects, working on the same problem? LearnBoost is offering an XML-ified version (http://www.learnboost.com/common-core/) but XML is foreign enough to me that I wouldn't be able to verify whether they've manged to avoid the scraping issues John mentions.
No movement that I know of
No movement that I know of ... thanks for the link to learnboost.
I'd recommend starting with what LearnBoost is providing
These can be exported into Drupal as taxonomy terms or nodes via the Feeds module.
They have provided a great starting point.
EDIT: and, just FYI, they are distributing the standards via a google spreadsheet, not XML.
FunnyMonkey
Ended Up Entering by hand and converting to xml via MS excel
The learnboost spreadsheet is missing some of the data, the markup, and special characters. We also needed 1 common spreadsheet for both sets of standards.
We scraped the screen on the website and did ok, but there were enough inconsistencies in the html that it was simpler start from scratch and cut and paste them into a spreadsheet and export them to xml to parse with php.
We are encapsulating these in a ccssi module for the project we are working on which will likely include the excel and xml versions of the document. And maybe functionality to export to a vocab. We will likely post it here when the main developer is happy with the xml/excel data.
We ended up with one spreadsheet with columns for:
standard_id
document (math or ela)
section_id
anchor (boolean)
super strand/super domain
strand/domain
strand/domain id
grade
cluster
number
letter
advanced (math) boolean
modeling (math) boolean
text (of standard)
www.johnbarclay.com
preliminary version of CCSSI standards available
The data John mentions above is available now in Excel spreadsheet form. I would like to get some feedback from interested consumers of the data, before making it public. Please contact me directly if you would like the spreadsheet, using the "Contact" tab on my user link.
Common Core on Excel
I'm new to the website and only got here because of this discussion. I was about to do the cut and paste method to translate the common core standards from .pdf to excel myself if necessary, but I'd love to take a look at yours if possible. How can I do that? Can you write me at ssupahan@mac.com?
CCSSI module submitted
FYI, I have submitted the "ccssi" module as an official project. I'm new to the CVS submission process so this will probably take a while, and doubtless there will be complaints about the quality of the code as I'm also still adapting to the Drupal coding standards. However, if anyone would like to play with the existing module, in what I would call "early alpha" stage, contact me and I'll ship you a tarball.
Great to see this!
I'm looking forward to testing this out -
We'll grab a copy of the latest release from the issue at http://drupal.org/node/1003408
RE coding standards: you could run your module through the coder module, which will catch many coding standards issues: http://drupal.org/project/coder
You could also take a look through the steps at http://groups.drupal.org/node/115554 - these steps will help address many of the issues that could get raised in the cvs review process.
FunnyMonkey
wow, they take "open" seriously around here
I did not realize that you could see the issue that constitutes my application for CVS access. That certainly makes it trivial to pick up a copy of the module. Let me know what you think.
I did run the module through "coder" and have read the application process guidelines. I suspect it's still going to be a long drawn-out process.
file for math standards available
Hi Folks,
I have a fairly decent version of a tab-delimited text file for the math standards. I am still working on replacing all of the weird characters with html codes (like theta and pi etc). But if anybody wants to take my version and improve it, feel free.
http://www.arps.org/Curriculum/Mathematics/CommonCore/CommonCore.txt
I recommend keeping the id numbers in the order I have them because they give you the proper presentation order.
I started from an Excel file that I found on a Colorado web site. Not sure now where I found it.
I am working on an interface for being able to search and also so we can upload district curriculum information in association with the standards.
Nina
RDF data for standards
You could also try using data from the Achievement Standard Network which offers standards data as RDF/XML. See the Common Core standards section. Best of all you get web resolvable URI's and the data is free to use under a Creative Commons attribution license.
commoncore.org
http://www.corestandards.org/developments-on-common-core-state-standards...
commoncore.org
An update to aaustin's reference, which leads to a 404 page. It appears CommonCore.org changed the URL - http://www.corestandards.org/common-core-state-standards-official-identi...
CSV - GoogleDoc spreadsheet
Here is a resource for a CSV copy of the standards:
https://docs.google.com/spreadsheet/ccc?key=0ArQGMTQa8JRadE5MWXpyUHNseHF...
CSV from Common Core State Standards web site
Adding to an old thread, but ran into it via a Google web search, in case its helpful, the canonical identifiers is available from the Common Core State Standards web site:
http://corestandards.org/assets/E0607_ccss_identifiers.csv