CSV, XML, YML, CommerceML Import queue for Cs-Cart Multi-Vendor Marketplace

Module CSV, XML, YML, CommerceML import queue (1C, MoySklad, Klass365 company programs)

The module forms a queue of import files received from sellers, preventing errors when writing to the database in parallel, and also eliminates server overload, reduces the risk of errors during parallel operation of several import modules.

How can I arrange the import of goods from different sellers?

As the marketplace grows, the number of sellers increases, and, consequently, the number of goods. Most of them prefer to import information about their products in one of two ways:

• Uploading a file in CSV format - (A text format designed to represent tabular data);
• File download in XML format - (files are written in a special markup language similar to HTML of web pages);
• Uploading a file in the format YML - (Standard YML(YandexMarket Language) developed by Yandex and based on the XML standard);
• Downloading a file from warehouse accounting programs in the format CommerceML – (Unified standard for the exchange of commercial information in XML format. The standard provides for the use of XML schemas, in particular, for the exchange of: product catalogs in catalog management systems.)

This is convenient for both the seller and the marketplace, allows you to download information about products or update balances quickly and without unnecessary hassle and costs.

However, downloading a large number of imports at the same time can cause several problems.

• Firstly, when 10 processes access the database at the same time, overwrite the information in it, there is a high risk that errors will occur: some information will be distorted, some new data will not be saved or will be saved with errors.
• Secondly, the buyer, opening the product card on the website, also initiates queries to the database. But at the same time, several hundred parallel processes from the import module are accessing it. This greatly reduces the response time to the request. The buyer has to wait a long time for the product card to finally load. Many buyers will simply get tired of waiting and go to competitors. And this cannot be allowed in any way.

And if you have 10 imports via files, you can still do something by setting different file upload times in the settings. But when you have hundreds of them, and the seller himself does the unloading from his programs automatically, then the seller adjusts the frequency and timing of the unloading of his warehouse accounting program himself. And, most often, synchronization is set up at the beginning of the working day. And so dozens of sales managers come to work at 9 a.m., turn on their computers, and warehouse accounting programs begin to synchronize. Server resources will sink under the shaft of simultaneous requests.

Module functionality "CSV, XML, YML, CommerceML import queue (My Warehouse, 1C, Class365)

As a solution, we suggest buying and installing the Import Queue module.

The module queues up the import processes one by one, which in itself reduces the load on the database. Only one file is uploaded at a time. The number of database accesses is limited, and the risk of errors is reduced.

In addition, the module regulates the start time of imports. You can set up regular automatic loading of imports for the time of the least load on the server from buyers.

If necessary, you can start loading imports into the queue manually by clicking the button. 

Detailed instructions for working with the module

The instructions are current at the time of publication. The module is regularly updated and improved. There may be minor differences in the control of the module.

CSV, XML, CommerceML import queue (MySklad, 1C, Class365)

The module arranges the order of imports to reduce the load on the database.

SCOPE OF APPLICATION

It is suitable for marketplaces with a large number of vendors who independently upload products to the site via 1C or using intelligent import.

APPLICATION EXAMPLE

In the case when a large number of sellers load a large number of goods, the module automatically queues imports and conducts them gradually, thereby not loading the system.

TECHNICAL SPECIFICATIONS

• Organizes the import queue;
• Allows you to import out of turn;
• Allows you to clear the import queue;
• Configures CRON queues and deletes imports.

COMMUNICATION WITH OTHER MODULES

Interacts with the modules "Import with moderation and auto-creation of characteristics" and "1C exchange".

MODULE SETTINGS

1. To configure the module, go to the "Modules" tab, select the "Module Management" item in the pop-up menu and the "MAURISWEB" section.

2. In the list that opens, select the module you are interested in and click on its name, highlighted in blue or black.

3. On the page that opens, select the "Basic" tab.In case the license key is not set automatically and the module settings are blocked, log in to your account at www.maurisweb.ru copy the license key and paste it into the appropriate item. The key has also been sent to your email address.

4. In the "Available domains" and "Test domains" sections, check the validity of the specified domains. You can add additional domains by clicking on the white "Add Domain" button on the right side of the page. The total number of domains should not exceed three.

5. Go down below, select the "Basic settings" section and check the box "Save data when deleting the module" so as not to lose them when reinstalling the module.

6. Go to the "CRON" tab and in the "Period for deleting completed imports" item expand the list and select the desired period when already completed imports will be deleted: "Day", "3 days", "Week", "2 weeks", "Month", "Six Months", "Year".

7. To set up import from the CRON queue, enter the appropriate command in the scheduler.

8. To set up queue cleanup, enter the appropriate command in the scheduler.

9. Save the module settings by clicking on the blue "Save" button in the upper right part of the panel.

MODULE FUNCTIONALITY

1. To set up an import queue, go to the "Administration" tab, select "Import data" and "Import Queue".

2. On the page that appears, a table will open listing all imports that were carried out through 1C or uploaded in CSV format (through the modules "1C Exchange" or "Import with moderation and auto-creation of characteristics"). The "Name" column displays the names of imports, "Queued" - the date of import processing by the module, "Started work" - the beginning of work with the import, "Finished work" - the end of work with the import.

3. To delete a specific import, click the blue gear-shaped button on the right side of the line and select the Delete function.