Content migration, import, and export

We encourage users to post events happening in the community to the community events group on https://www.drupal.org.

Converting a web site from one content management system (or - ack! - raw HTML files) to another is always challenging. Going to Drupal is no exception. How does one go about it? What are the challenges and what's the best way to meet them? And what about exporting content from Drupal for use by other systems?

This group (formerly Data Import/Export, devoted to one solution) is for discussion of best practices in content migration. How do you manage the process? What are the things that are likely to trip you up? What tools are available?

In the short term, a major focus in this group is seeing if we can consolidate some of the myriad existing tools to aid in migration.

mtbosworth's picture

Importing CSV data into Drupal 6 CCK content types

I have converted an MSSQL export to MySQL. Exported to CSV for import. Are their any field mapping tools for Drupal or am I doomed to write my own script?

Thanks in advance.

Read more
Mark Tully's picture

Migrating from OpenPublish to OpenPublish

[Sorry for cross-posting.]

I'd like to migrate users, content, and uploaded files from one OpenPublish installation to another. I'm not very familiar with databases, but can do imports and exports... Which tables should I pay attention to?

Read more
SocialNicheGuru's picture

Content Syndication using Feeds. How do I make it secure?

I am taking a look at using feeds to push content from one site to another.
Reading the pages for Feeds Atom, Views Atom, and Push_Hub it looks like push hub will notify if someting changes on the host server.

I was wondering how I make the feed only available to another machine of my choosing and not allow it to be world readable?

Services allows for key authentication.

Does feeds module have a similar option?

Read more
colan's picture

New module: Syndeploy

I just posted a new module called Syndeploy. It provides content changes through syndication, that can be used to deploy from staging to production. It's sort of a pull version of Deploy. Please see the project page for details. I'm just getting into heavy development now, so please reply if you have any thoughts on this. Thanks!

Read more
wsgarvey's picture

How to import custom fields along with standard fields for users and/or nodes.

Doing a migration to Drupal 7 from another CMS and trying to import content and users. Can import basic fields just fine, but custom fields aren't working. Tried two ways: direct to MySql database and using drupal cmds.

(1) using sql insert

"INSERT INTO users (name, mail, uid, pass, ...) VALUES (blah, blah, blah, blah, ...), (...); " -- works great. able to login with old user id and password (pass is pre-hashed by Drupal routine).

Read more
R.J. Steinert's picture

Views is to queries is what Data Wrangler Parsing Plugin will be to parsing algorithms

If you've ever had headaches transforming a dataset you need to see the Data Wrangler platform. Data Wrangler demonstrates predictive data transforming and parsing script generation. This is exciting because just as Drupal Views lowers the barrier to entry and speeds up writing database queries, Data Wrangler lowers the barrier to entry and speeds up creating scripts to transform complicated datasets.

Read more
michaelsilverman's picture

Synchronizing Date content types with personal calendars

Have a website that is using the Date and Calendar modules. Need to allow user to upload these events into their personal calendars (or a Google calendar). Can export initial events via the Views ICAL display type but subsequent uploads create duplicate calendar entries. Anyone have a method to synch calendars?

Read more
jsimonis's picture

Importing from a csv file

I have a csv file that has all the data for our nodes. The node is primarily cck fields, plus the standard title and body. The fields are all one of the following:

text box
text area
content taxonomy (checkboxes)
a few yes/no radios
checkboxes
one hierarchial select

Read more
wonder95's picture

How to use Migrate module for nightly import

I have a project that involves a nightly importing of data from an external source, and from what I've seen Migrate module would be a more robust solution that me writing code. I've been looking at it but haven't been able to figure out how to implement it to fit my needs, so I'm hoping someone here might be able to shed some light on it for me.

Read more
nickvidal's picture

Drupal 7 and Sencha Touch

I've created a demo to show how Drupal and Sencha Touch can work together. The demo is called "Tea Sencha Network" and it displays information from Sencha's official blog.

Please access:

<

ul>

  • the Mobile UI (http://teasencha.net), built on top of Sencha Touch,
  • the Green TEAm (http://green.teasencha.net), built on top of Drupal 7,
  • Read more
    nik_ek's picture

    Importing site or frames?

    Hi

    First, I'm sorry if this is the wrong place to post. It was the best I could find ;)

    Now, I need to build an "Art on Demand" website. This is a system that sells reprints of art. The site can be seen at http://advancedimaging.artondemand.eu

    Now, there's nothing I can do about this system, but my client wants additional pages with information, so at least a top menu with more or less static pages. He might also want a preview of shopping basket on one of these pages.

    Read more
    rgracia's picture

    Migrating some content to a new Drupal site from an old Drupal site

    Hi Group members, I need some guidance...

    We have a Drupal site in the beginning stages of a redesign. As part of the agreed new design, only three content types (and their corresponding existing nodes in the database) will need to be migrated to the new site and new database. Is there a module that allows me to selectively choose nodes from particular content types and export in a format that can be imported as content in the new site? Both sites being Drupal sites...

    Read more
    Daniel A. Beilinson's picture

    Data synchronization between fields in different drupal installations

    Hello brothers!
    I want to discuss data synchronization between drupal sites with you. I mean more specific problem - data synchronization between fields in few drupal installations. In my case I have something strong intranet or database and I want to give someone users ability to send data into another drupal site which has same cck architecture. And I don't want to send whole node, i want to send datа from some fields. No, I don't want to send them. I want to synchronize them. For example with checkboxes near by cck fields and sync button.

    Read more
    demonrage's picture

    importing posts from ipboard to drupal

    hello,

    i have successfully managed to import my topics and posts from ipboard 3.1 to drupal 6.x using migrate and table wizard. all the content and topics imported into drupal safely but i have a small problem and i can't find out a solution for it.

    my ipboard topics and posts are written in Arabic language, when importing data into drupal and preview them the language appeared with weird characters like this (العنود).

    Read more
    Amazon's picture

    Selling Drupal 7 now: How Examiner.com, possibly the largest Drupal site ever, is migrating from Coldfusion to Drupal 7

    Start: 
    2010-04-08 13:00 America/New_York
    Event type: 
    User group meeting

    Hi, with every Drupal release there is a big question about when the next release of Drupal will be ready for big sites. Come learn about how examiner.com is migrating their site, and particularly how they are migrating their data to Drupal 7.

    Here's the details:
    http://acquia.com/resources/webinars/peek-behind-scenes-%E2%80%93-how-cl...

    Read more
    rcrowe's picture

    Migrate imported data but doesn't display in content

    Pardon in advance if this is a dumb question - I am a new Drupaller and am having a bit of a time understanding what's going on behind the scenes.

    I have a job listing on an old server that I want to pull into Drupal. I built a content-type "job" and a view "job_list" on my beta site, and successfully migrated all the data using Table Wizard, Migrate and Migrate Extras. Everything was working fine, until I realized I needed to run this site as a subdomain rather than a subdirectory.

    Read more
    thekenshow's picture

    CCK Fields Missing from Content Set Mapping: Solved

    I'm posting this because I just spent way too long trying to figure out why all CCK fields were suddenly missing (absent, not showing up) as destination fields on the mapping page of a content set for the Migrate module. The answer is in plain site on the Migrate project page and discernible in the CHANGELOG.txt.

    Migrate Extras. Optional, but for releases after Beta 4 you need this module to be able to migrate CCK fields, as well as other contrib modules previously supported natively in Migrate.

    Read more
    Anonymous's picture

    Migration module for Ingeniux CMS

    Our university is moving from the Ineniux CMS to drupal - a site with over 10,000 pages, thousands of images and documents -- and all spread out over at least 80 subdomains.

    To support this, we have been working on an Ingeniux Migrate Module which has support for migrating content, images, attachments, and relationships between Ingeniux sites and Domain Access data (optional).

    Read more
    Matthew Davidson's picture

    Field Tool: Help Eliminate Wheel Reinvention in Import/Export/Synchronization/Migration/Whatever

    Last year, jpetso created the Field Tool project to provide a low-level API for (among other things) getting data in and out of fields in a simple and consistent way (also Transformations for further up the stack, but first things first...). Unfortunately since then he's had had a lot less spare time, so this is a call for help on this obvious Good Idea. Ever been frustrated by the many different ways fields can store values of varying complexity, and having to code your own data import/export handlers for every module you might be using that provides field types? You can help solve this problem!

    Read more
    rimian's picture

    simple Import API

    Hi,

    I've got myself a basic import API that I'd like to share if anyone is interested.

    It can import nodes, users, taxonomy terms or anything you care to. The core module itself doesn't do anything except read a CSV file and delegate to other modules for merging and saving data.

    This module assumes you can get your content into CSV and upload it to the server somewhere and is only suitable for developers at this stage.

    See:
    http://github.com/rimian/rimian

    Cheers,
    Rim

    Read more
    Subscribe with RSS Syndicate content

    Content migration, import, and export

    Group organizers

    Group notifications

    This group offers an RSS feed. Or subscribe to these personalized, sitewide feeds:

    Hot content this week