Split Large XML File Into Smaller Files

Question

I have a ecommerce site that needs to update products via a huge XML file downloaded via ftp from the distributor.

The products.xml file is approx 21MB in size and pulling the data and looping through it is simply too exhaustive for a single pass.

I need to be able to split the original XML file or my processed SimpleXMLElement into 1000 products each, then load the files and process them separately.

I'm pulling the xml into a SimpleXMLElement then casting it to an array so it looks like so:

[1] => Array
    (
        [PRODUCTS_NAME] => Product Name
        [PRODUCTS_DESCRIPTION] => Product Description
        [PRODUCTS_IMAGE] => 1234.jpg
        [PRODUCTS_PRICE] => 9.99
        [PRODUCTS_MODEL] => 1234
        [ITEM_BRANDNAME] => Acme Inc.
        [ITEM_UPC] => 01234567890
        [ITEM_HEIGHT] => 0.500
        [ITEM_LENGTH] => 4.250
        [ITEM_DIAMETER] => 3.375
        [PRODUCTS_WEIGHT] => 0.05
        [MANUFACTURERS_NAME] => Acme Distributors
        [ITEM_VENDOR_NUMBER] => XXX-1234
        [PRODUCTS_QUANTITY] => 100
        [DATE_RECIEVED] => 0000-00-00 00:00:00
        [PROP_PACKAGING] => Blister Card
        [PRODUCT_CLASS] => BAT
        [PRODUCTS_TYPE] => Batteries
    )

How can I create individual files of 1000 products in each file and save them?

I know it's tangential to the question, but why are you casting the object into an array? The whole point of SimpleXML is that you can access it like an object or array and pull out whichever details you want. — IMSoP, Aug 26 '13 at 16:48

Bora · Answer 1 · 2013-08-26T17:51:10.080

3

You can do this with simplexml functions:

$xml = simplexml_load_file('products.xml');

foreach($xml as $id => $product)
{
    $product->asXml($id.'.xml');
}

You can use simplexml_load_string instead of simplexml_load_file

$xml = simplexml_load_string($products);

Note: Have to be SimpleXMLElement

edited Aug 26 '13 at 17:51

answered Aug 26 '13 at 14:35

Bora

10,529
5
43
73

score 0 · Accepted Answer · edited May 23 '17 at 12:13

0

Switched to XMLReader with XMLReaderIterator

and used the instructions here.

Really nice implementation, thanks to hakre for building that, works awesome.

edited May 23 '17 at 12:13

Community

1
1

answered Aug 27 '13 at 09:31

secondman

3,233
6
43
66

Split Large XML File Into Smaller Files

2 Answers2