[consulting] Database migration script or copy/paste?

Tue Apr 20 14:04:32 UTC 2010

Victor, 

Thanks. That sounds incredible. I totally agree with you. I¹m fine spending
hours setting up an automated system that works because just with the few
sites that I¹ve done I¹m disgusted that it takes so long to insert content.

Holly

On 4/20/10 6:01 AM, "Victor Kane" <victorkane at gmail.com> wrote:

> You will save a great deal of time with the mis-named "Node Export"
> module: drupal.org/project/node_export <http://drupal.org/project/node_export>
>  
> It also handles bulk export, import, and I have used it to import thousands of
> nodes stored in a CSV format.
> But, as Khalid says, there are no pictures or node references; from the
> project page:
> 
> "Since the bulk export feature has been added, a lot of people have assumed
> this module will allow you to export the structure of a whole site and keep
> things like menu links, authors, node references, book hierarchy, etc.. BUT NO
> IT DOESN'T. The reason is that the ID values that are used to identify the
> connections between things like that get changed around during an import.
> There are hooks that allow manipulation of nodes during imports/exports that
> could allow a programmer to add support for these features by tracking
> additional data to be able to fix the nodes afterwards, but nobody has gone to
> the trouble of doing that yet."
> 
> It is indeed amazing that no-one has gone to that trouble, or has shared
> solutions. For complex data structures, there is the migration module and the
> table wizard, which were designed for huge sites, and which the makers chose
> to share.
> 
> The node_import module might be of use also, or roll your own script based on
> many snippets in the Drupal handbook and around the web.
> 
> This discussion on drupal.org <http://drupal.org>  sums the "state of the art"
> perfectly:
> 
> drupal.org/node/762022#comment-2806388
> <http://drupal.org/node/762022#comment-2806388>  and refers you to the
> discussion where there are some examples: drupal.org/node/178506
> <http://drupal.org/node/178506>  (creating a node programmatically). 
> 
> Also: acquia.com/blog/migrating-drupal-way-part-i-creating-node
> <http://acquia.com/blog/migrating-drupal-way-part-i-creating-node>
> 
> The import_html module is an option, but it brings a lot of overhead into the
> site in my opinion.
> 
> A script to import static HTML would work by iterating over the files in a
> directory and then using common PHP functions to read in the text, and then
> extracting the body and sticking it into the body of the Drupal node. You can
> use a regular expression for that, or, this module is very
> interesting: drupal.org/project/querypath
> <http://drupal.org/project/querypath>
> Based on a "scraper" kind of program, It allows an "xpath" like approach for
> common html files. Check it out.
> 
> Any of these approaches are better than copying and pasting. A developer needs
> to shun copying and pasting. Even if you spend more time automating the
> process than brute force, you will have reusable tools.
> 
> Victor Kane
> http://awebfactory.com.ar
> http://projectflowandtracker.com
> 
> On Tue, Apr 20, 2010 at 2:17 AM, Holly Ferree <hferree at gmail.com> wrote:
>> Hi Bob,
>> 
>> Thanks for the input. I'm not web to scripts... I just didn't know what else
>> to call them... I just want to know if there is a better way to insert a lot
>> of content without so much clicking and copying/pasting. :)
>> 
>> I am so thrilled to know about all these modules that I can try!
>> 
>> I was curious if Excel could be used (it's all tables anyways)... Would you
>> export it was a .csv?
>> 
>> Thanks,
>> Holly
>> 
>> 
>> On 4/20/10 12:12 AM, "Bob Schmitt" <bobschmitt at xinsys.net> wrote:
>> 
>>> > I've had pretty good luck with the Import/Export module
>>> > (http://drupal.org/project/import_export_tool) and the Node Export module
>>> > (http://drupal.org/project/node_export). I can't remember which one is the
>>> > best, but I have used them to dump/import more than 30K nodes organized in
>>> in
>>> > 7 cck node types. It worked pretty well except for importing multiple
>>> taxonomy
>>> > terms per node.
>>> >
>>> > I've also used these modules to migrate content from other sites into
>>> Drupal
>>> > sites using Excel and FilemakerPro as intermediary platforms to massage
>>> the
>>> > data into the correct formats prior to the migration.
>>> >
>>> > Strictly speaking, neither of these are database migration scripts, but
>>> the
>>> > get the job done.
>>> >
>>> > bob
>>> >
>>> > On Apr 19, 2010, at 9:11 PM, Holly Ferree wrote:
>>> >
>>> > Hi All,
>>> >
>>> > What is the most efficient way of transferring a site's content of 10
>>> pages
>>> > or more into drupal? (basically past the realm that you would want to copy
>>> > and paste all the content to where another option would be easier to add a
>>> > good amount of content would be the way to go)
>>> >
>>> > I have done the copy/paste of hundreds of lines of content from Word and
>>> > done the whole create content > page, paste and format content, save page,
>>> > repeat process till I thought I would die of boredom...
>>> >
>>> > Please tell me there is a better way! (these sites have been from scratch
>>> or
>>> > have not used a database previously. )
>>> >
>>> > Thanks,
>>> >
>>> > Holly Ferree, Graphic Designer, BFA
>>> > hferree at gmail.com
>>> > http://www.designbyholly.com/
>>> >
>>> >
>>> > PS I would also prefer to do it myself and not hire someone who doesn't
>>> mind
>>> > repetitive work... :)
>>> >
>>> >
>>> > _______________________________________________
>>> > consulting mailing list
>>> > consulting at drupal.org
>>> > http://lists.drupal.org/mailman/listinfo/consulting
>>> >
>>> > Bob Schmitt
>>> > 432 Harrison Ave.
>>> > Helena, MT 59601
>>> > Voice: +1.406.459.6537
>>> > Skype: captbobalou
>>> >
>>> >
>>> >
>>> > _______________________________________________
>>> > consulting mailing list
>>> > consulting at drupal.org
>>> > http://lists.drupal.org/mailman/listinfo/consulting
>> 
>> Holly Ferree, Graphic Designer, BFA
>> hferree at gmail.com
>> http://www.designbyholly.com/
>> 
>> 
>> _______________________________________________
>> consulting mailing list
>> consulting at drupal.org
>> http://lists.drupal.org/mailman/listinfo/consulting
> 
> 
> 
> _______________________________________________
> consulting mailing list
> consulting at drupal.org
> http://lists.drupal.org/mailman/listinfo/consulting

Holly Ferree, Graphic Designer, BFA
813.786.0852
hferree at gmail.com
http://www.designbyholly.com/

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.drupal.org/pipermail/consulting/attachments/20100420/23f480ff/attachment.html 