Content migration, import, and export

Converting a web site from one content management system (or - ack! - raw HTML files) to another is always challenging. Going to Drupal is no exception. How does one go about it? What are the challenges and what's the best way to meet them? And what about exporting content from Drupal for use by other systems?

This group (formerly Data Import/Export, devoted to one solution) is for discussion of best practices in content migration. How do you manage the process? What are the things that are likely to trip you up? What tools are available?

In the short term, a major focus in this group is seeing if we can consolidate some of the myriad existing tools to aid in migration.

New Export/Import module has been updated

Hi,

The previously mentioned new data export and import module has been extensively updated.

Now, all content types can be exported and imported - as well as the taxonomy terms.

I would appreciate some help with getting the module reviewed. The project is at:

http://drupal.org/sandbox/bailey86/1278830

and the issue is at:

http://drupal.org/node/1330454

Login or register to post comments · 2 attachments

Freelance Developer and Site Support | Building Materials Reuse Association

Employment type: 
Part time
Employment type: 
Contract
Telecommute: 
Allowed

The Building Materials Reuse Association is seeking contract assistance for two items on our drupal website, www.bmra.org.

  1. We are seeking a developer to assist in creating an online calculator of lifecycle emissions associated with various uses for wood waste. This calculator will draw on our existing database of emissions values, and must be robust enough to widely usable by the general public. Additional details will be made available upon response.
Read more
tedbow's picture

Exporting Entities to CSV(or other files)

I have written a new module Entityforms that allows user to create front-end forms that are entities. The submissions are also fieldable entities. I was wondering if there is a module that can export any Entity type, not just nodes and users, into csv files. I would want the ability to bulk export the submission entities(or any entity) to csv files.

I know I can do this with Views Data Export but I would have to make the view for each entity type.

3 comments · Read more

Web Migration Editor/Analyst Level 2 | CentreIT

Employment type: 
Contract
Telecommute: 
Not allowed

CentreIT Recruiting currently has a position for a Web Editor Level 2 located in Washington DC. It requires someone with web and copy editing skills as well as web content migration experience. Further detailed information can be found at http://clm.bz/M6JU and resumes can either be sent through Climber or direct to recruiter@centreit.com.

Nucleus to Drupal 6.x; Xoops to Drupal 6.x

Hello group,

If someone is looking to a simple tool to migrate Nucleus CMS or XOOPS CMS base websites to Drupal - feel free to try my scripts.

https://github.com/dpovshed/nucleus_migration_to_drupal
https://github.com/dpovshed/xoops_migration_to_drupal#readme

Both of those was made by request and sponsored by http://weblab.tk

Implementation was made more than a year ago and now we have really robust tools like Feeds. However if these small tools will be used as is or as a base for more powerful solution - I'll be happy.

Regards,
Dennis.

Login or register to post comments

A new module - Data Export Import - needs testing and reviewing

Hi,

I have built a module which exports nodes and taxonomy terms to data files - which can then be imported into other Drupal instances.

http://drupal.org/sandbox/bailey86/1278830

I need some help to get it accepted as a full Drupal module. Currently I have a development branch which extends the module to export/import all content types including those with CCK files and file fields - but I'd like to get the initial module as a full Drupal module asap.

4 comments · Read more · 3 attachments
mtbosworth's picture

Importing CSV data into Drupal 6 CCK content types

I have converted an MSSQL export to MySQL. Exported to CSV for import. Are their any field mapping tools for Drupal or am I doomed to write my own script?

Thanks in advance.

6 comments
adam_b's picture

Data migration | Phaidon Press Ltd

Employment type: 
Contract
Telecommute: 
Allowed

Phaidon Press is working on a project which involves migrating a large database from FileMaker Pro to Drupal 7.

The first stage, exporting from FileMaker to a generic MySQL database, is in hand now, but we need someone to undertake the job of importing the data from the generic database to Drupal 7. Depending on how the data is organized, there are potentially about 5000 nodes and 52000 media assets (almost all of these images).

Read more

Migrating from OpenPublish to OpenPublish

[Sorry for cross-posting.]

I'd like to migrate users, content, and uploaded files from one OpenPublish installation to another. I'm not very familiar with databases, but can do imports and exports... Which tables should I pay attention to?

Login or register to post comments

Content Syndication using Feeds. How do I make it secure?

I am taking a look at using feeds to push content from one site to another.
Reading the pages for Feeds Atom, Views Atom, and Push_Hub it looks like push hub will notify if someting changes on the host server.

I was wondering how I make the feed only available to another machine of my choosing and not allow it to be world readable?

Services allows for key authentication.

Does feeds module have a similar option?

Login or register to post comments
colan's picture

New module: Syndeploy

I just posted a new module called Syndeploy. It provides content changes through syndication, that can be used to deploy from staging to production. It's sort of a pull version of Deploy. Please see the project page for details. I'm just getting into heavy development now, so please reply if you have any thoughts on this. Thanks!

Login or register to post comments

How to import custom fields along with standard fields for users and/or nodes.

Doing a migration to Drupal 7 from another CMS and trying to import content and users. Can import basic fields just fine, but custom fields aren't working. Tried two ways: direct to MySql database and using drupal cmds.

(1) using sql insert

"INSERT INTO users (name, mail, uid, pass, ...) VALUES (blah, blah, blah, blah, ...), (...); " -- works great. able to login with old user id and password (pass is pre-hashed by Drupal routine).

4 comments · Read more
rjsteinert's picture

Views is to queries is what Data Wrangler Parsing Plugin will be to parsing algorithms

If you've ever had headaches transforming a dataset you need to see the Data Wrangler platform. Data Wrangler demonstrates predictive data transforming and parsing script generation. This is exciting because just as Drupal Views lowers the barrier to entry and speeds up writing database queries, Data Wrangler lowers the barrier to entry and speeds up creating scripts to transform complicated datasets.

Login or register to post comments · Read more · 1 attachment

Synchronizing Date content types with personal calendars

Have a website that is using the Date and Calendar modules. Need to allow user to upload these events into their personal calendars (or a Google calendar). Can export initial events via the Views ICAL display type but subsequent uploads create duplicate calendar entries. Anyone have a method to synch calendars?

Login or register to post comments
jsimonis's picture

Importing from a csv file

I have a csv file that has all the data for our nodes. The node is primarily cck fields, plus the standard title and body. The fields are all one of the following:

text box
text area
content taxonomy (checkboxes)
a few yes/no radios
checkboxes
one hierarchial select

15 comments · Read more
wonder95's picture

How to use Migrate module for nightly import

I have a project that involves a nightly importing of data from an external source, and from what I've seen Migrate module would be a more robust solution that me writing code. I've been looking at it but haven't been able to figure out how to implement it to fit my needs, so I'm hoping someone here might be able to shed some light on it for me.

5 comments · Read more

Request For Proposal | National September 11 Memorial and Museum

Employment type: 
Contract
Telecommute: 
Allowed

/* THIS OPENING IS NOW CLOSED. THANK YOU FOR SUBMITTING THE PROPOSALS TO US. */

The 9/11 Memorial is planning to migrate its website (http://www.national911memorial.org) to the Drupal platform. Time is an important constraint for us and we wish to make this migration asap. If your company would be interested in bidding for this website migration project, please find attached the RFP that contains the detailed information of our migration needs. Thank you for investing time with our company. We look forward to receiving your proposals soon.

Read more · 1 attachment
nickvidal's picture

Drupal 7 and Sencha Touch

I've created a demo to show how Drupal and Sencha Touch can work together. The demo is called "Tea Sencha Network" and it displays information from Sencha's official blog.

Please access:

<

ul>

  • the Mobile UI (http://teasencha.net), built on top of Sencha Touch,
  • the Green TEAm (http://green.teasencha.net), built on top of Drupal 7,
  • 18 comments · Read more

    Importing site or frames?

    Hi

    First, I'm sorry if this is the wrong place to post. It was the best I could find ;)

    Now, I need to build an "Art on Demand" website. This is a system that sells reprints of art. The site can be seen at http://advancedimaging.artondemand.eu

    Now, there's nothing I can do about this system, but my client wants additional pages with information, so at least a top menu with more or less static pages. He might also want a preview of shopping basket on one of these pages.

    Login or register to post comments · Read more
    rgracia's picture

    Migrating some content to a new Drupal site from an old Drupal site

    Hi Group members, I need some guidance...

    We have a Drupal site in the beginning stages of a redesign. As part of the agreed new design, only three content types (and their corresponding existing nodes in the database) will need to be migrated to the new site and new database. Is there a module that allows me to selectively choose nodes from particular content types and export in a format that can be imported as content in the new site? Both sites being Drupal sites...

    4 comments · Read more
    Syndicate content