Merge pull request #205 from magento-nord/develop

Data Migration Tool Release 2.1.3

CHANGELOG.md

@@ -1,3 +1,18 @@
+2.1.3
+=============
+* New DataIntegrity Step to check orphan records in database of Magento 1
+* Added support for mapping in the TierPrice Step
+* Added support for migration for the following versions:
+
+    * Magento CE version 1.9.3.1, 2.1.3
+    * Magento EE version 1.14.3.1, 2.1.3
+
+* Fixed bugs:
+    * Error in TierPrice Step when checking record structure and `value_id` field is unset
+    * [Issue #123](https://github.com/magento/data-migration-tool/issues/123): `Integrity constraint violation` error in the EAV step in case of orphan records in database 
+    * [Issue #170](https://github.com/magento/data-migration-tool/issues/170): Cannot open product edit page due to an error about required design component
+    * [Issue #6510](https://github.com/magento/magento2/issues/6510): Empty Attributes frontend_input params cause errors on migrated store
+
 2.1.2
 =============
 * Added support for migration for the following versions:

README.md

@@ -1,15 +1,20 @@
 ## Overview
 We're pleased you're considering moving from the world's #1 eCommerce platform—Magento 1.x—to the eCommerce platform for the future, Magento 2. We're also excited to share the details about this process, which we refer to as migration.
 
-Magento 2 migration involves four components: data, extensions, themes, and customizations. 
+Magento 2 migration involves four components: data, extensions and custom code, themes, and customizations.
 
-*	Data: We've developed the Magento 2 Data Migration Tool to help you efficiently move all of your products, customers, and order data, store configurations, promotions and more to Magento 2. 
+### Data
+We've developed the **Magento 2 Data Migration Tool** to help you efficiently move all of your products, customers, and order data, store configurations, promotions and more to Magento 2. See the <a href="http://devdocs.magento.com/guides/v2.1/migration/bk-migration-guide.html" target="_blank">Magento Migration Guide</a> for details.
 
-*	Custom code: Code is not ported because it cannot be automated.
+### Extensions and custom code
+We've been working hard with the development community to help you use your Magento 1 extensions in Magento 2. Now we're proud to present the <a href="https://marketplace.magento.com/" target="_blank">Magento Marketplace</a>, where you can download or purchase the latest versions of your favourite extensions.
 
-*	Extensions: We are working with the Magento development community on updating extensions. They will be on Magento Connect when Magento 2 becomes generally available. More information on developing extensions for Magento 2 is available in the <a href="http://devdocs.magento.com/guides/v1.0/extension-dev-guide/bk-extension-dev-guide.html">Magento 2 Extension Developer Guide</a>.
+Also, we have developed the <a href="https://github.com/magento/code-migration" target="_blank">Code Migration Toolkit</a>, which will help to port extensions and your custom code to Magento 2, significantly reducing your porting efforts.
 
-*	Themes and Customizations: Magento 2 uses new approaches and technologies that give merchants an unmatched ability to create innovative shopping experiences and scale to new levels. To take advantage of these advances, developers will need to make changes to their themes and customizations. Documentation is available online for creating Magento 2 <a href="http://devdocs.magento.com/guides/v1.0/frontend-dev-guide/themes/theme-general.html">themes</a>, <a href="http://devdocs.magento.com/guides/v1.0/frontend-dev-guide/layouts/layout-overview.html">layouts</a>, and <a href="http://devdocs.magento.com/guides/v1.0/frontend-dev-guide/layouts/xml-manage.html">customizations</a>.
+More information on developing extensions for Magento 2 is available in the <a href="http://devdocs.magento.com/guides/v1.0/extension-dev-guide/bk-extension-dev-guide.html" target="_blank">Magento 2 Extension Developer Guide</a>.
+
+### Themes and Customizations
+Magento 2 uses new approaches and technologies that give merchants an unmatched ability to create innovative shopping experiences and scale to new levels. To take advantage of these advances, developers will need to make changes to their themes and customizations. Documentation is available online for creating Magento 2 <a href="http://devdocs.magento.com/guides/v1.0/frontend-dev-guide/themes/theme-general.html" target="_blank">themes</a>, <a href="http://devdocs.magento.com/guides/v1.0/frontend-dev-guide/layouts/layout-overview.html" target="_blank">layouts</a>, and <a href="http://devdocs.magento.com/guides/v1.0/frontend-dev-guide/layouts/xml-manage.html" target="_blank">customizations</a>.
 
 ### Supported versions
 This edition of tool supports the following versions for migration:
@@ -63,7 +68,7 @@ To install the migration tool from GitHub, use the following steps:
 3.	Wait while dependencies are updated.
 
 ### Install the tool from repo.magento.com
-To install the Data Migration Tool, you must update `composer.json` in the Magento root installation directory to provide the location of the migration tool package. 
+To install the Data Migration Tool, you must update `composer.json` in the Magento root installation directory to provide the location of the migration tool package.
 
 To install the migration tool, you must:
 
@@ -99,5 +104,5 @@ To update `composer.json`:
 
 9.	Wait while dependencies are installed.
 
-## For more details
-See the <a href="http://devdocs.magento.com/guides/v2.1/migration/bk-migration-guide.html">Migration User Guide</a>.
+## More details
+See the <a href="http://devdocs.magento.com/guides/v2.1/migration/bk-migration-guide.html">Migration Guide</a> for the detailed help with your data migration process.

composer.json

@@ -1,7 +1,7 @@
 {
     "name": "magento/data-migration-tool",
     "description": "Migration Tool",
-    "version": "2.1.2",
+    "version": "2.1.3",
     "require": {
         "symfony/console": "~2.3",
         "magento/framework": "~100.1",

etc/ce-to-ce/1.6.0.0/config.xml.dist

@@ -18,6 +18,9 @@
         </step>
     </steps>
     <steps mode="data">
+        <step title="Data Integrity Step">
+            <integrity>Migration\Step\DataIntegrity\Integrity</integrity>
+        </step>
         <step title="EAV Step">
             <integrity>Migration\Step\Eav\Integrity</integrity>
             <data>Migration\Step\Eav\Data</data>
@@ -115,6 +118,7 @@
         <order_grids_document_groups_file>etc/ce-to-ce/order-grids-document-groups.xml.dist</order_grids_document_groups_file>
         <map_document_groups>etc/ce-to-ce/map-document-groups.xml.dist</map_document_groups>
         <class_map>etc/ce-to-ce/class-map.xml.dist</class_map>
+        <tier_price_map_file>etc/ce-to-ce/map-tier-price.xml.dist</tier_price_map_file>
         <!--
         In case bulk_size=0 it will be auto-detected for every document.
         -->

etc/ce-to-ce/1.6.0.0/map.xml.dist

@@ -832,6 +832,20 @@
                     <param name="entityTypeCode" value="catalog_category"/>
                 </handler>
             </transform>
+            <transform>
+                <field>catalog_category_entity_varchar.value</field>
+                <handler class="\Migration\Handler\SetValueAttributeCondition">
+                     <param name="attributeCode" value="custom_design"/>
+                     <param name="value" value="null"/>
+                </handler>
+            </transform>
+            <transform>
+                <field>catalog_category_entity_text.value</field>
+                <handler class="\Migration\Handler\SetValueAttributeCondition">
+                     <param name="attributeCode" value="custom_layout_update"/>
+                     <param name="value" value="null"/>
+                </handler>
+            </transform>
             <transform>
                 <field>catalog_product_entity_varchar.value</field>
                 <handler class="\Migration\Handler\ConvertEavValue">

etc/ce-to-ce/1.6.1.0/config.xml.dist

@@ -18,6 +18,9 @@
         </step>
     </steps>
     <steps mode="data">
+        <step title="Data Integrity Step">
+            <integrity>Migration\Step\DataIntegrity\Integrity</integrity>
+        </step>
         <step title="EAV Step">
             <integrity>Migration\Step\Eav\Integrity</integrity>
             <data>Migration\Step\Eav\Data</data>
@@ -115,6 +118,7 @@
         <order_grids_document_groups_file>etc/ce-to-ce/order-grids-document-groups.xml.dist</order_grids_document_groups_file>
         <map_document_groups>etc/ce-to-ce/map-document-groups.xml.dist</map_document_groups>
         <class_map>etc/ce-to-ce/class-map.xml.dist</class_map>
+        <tier_price_map_file>etc/ce-to-ce/map-tier-price.xml.dist</tier_price_map_file>
         <!--
         In case bulk_size=0 it will be auto-detected for every document.
         -->

etc/ce-to-ce/1.6.1.0/map.xml.dist

@@ -829,6 +829,20 @@
                     <param name="entityTypeCode" value="catalog_category"/>
                 </handler>
             </transform>
+            <transform>
+                <field>catalog_category_entity_varchar.value</field>
+                <handler class="\Migration\Handler\SetValueAttributeCondition">
+                     <param name="attributeCode" value="custom_design"/>
+                     <param name="value" value="null"/>
+                </handler>
+            </transform>
+            <transform>
+                <field>catalog_category_entity_text.value</field>
+                <handler class="\Migration\Handler\SetValueAttributeCondition">
+                     <param name="attributeCode" value="custom_layout_update"/>
+                     <param name="value" value="null"/>
+                </handler>
+            </transform>
             <transform>
                 <field>catalog_product_entity_varchar.value</field>
                 <handler class="\Migration\Handler\ConvertEavValue">

etc/ce-to-ce/1.6.2.0/config.xml.dist

@@ -18,6 +18,9 @@
         </step>
     </steps>
     <steps mode="data">
+        <step title="Data Integrity Step">
+            <integrity>Migration\Step\DataIntegrity\Integrity</integrity>
+        </step>
         <step title="EAV Step">
             <integrity>Migration\Step\Eav\Integrity</integrity>
             <data>Migration\Step\Eav\Data</data>
@@ -115,6 +118,7 @@
         <order_grids_document_groups_file>etc/ce-to-ce/order-grids-document-groups.xml.dist</order_grids_document_groups_file>
         <map_document_groups>etc/ce-to-ce/map-document-groups.xml.dist</map_document_groups>
         <class_map>etc/ce-to-ce/class-map.xml.dist</class_map>
+        <tier_price_map_file>etc/ce-to-ce/map-tier-price.xml.dist</tier_price_map_file>
         <!--
         In case bulk_size=0 it will be auto-detected for every document.
         -->

etc/ce-to-ce/1.6.2.0/map.xml.dist

@@ -829,6 +829,20 @@
                     <param name="entityTypeCode" value="catalog_category"/>
                 </handler>
             </transform>
+            <transform>
+                <field>catalog_category_entity_varchar.value</field>
+                <handler class="\Migration\Handler\SetValueAttributeCondition">
+                     <param name="attributeCode" value="custom_design"/>
+                     <param name="value" value="null"/>
+                </handler>
+            </transform>
+            <transform>
+                <field>catalog_category_entity_text.value</field>
+                <handler class="\Migration\Handler\SetValueAttributeCondition">
+                     <param name="attributeCode" value="custom_layout_update"/>
+                     <param name="value" value="null"/>
+                </handler>
+            </transform>
             <transform>
                 <field>catalog_product_entity_varchar.value</field>
                 <handler class="\Migration\Handler\ConvertEavValue">

etc/ce-to-ce/1.7.0.0/config.xml.dist

@@ -18,6 +18,9 @@
         </step>
     </steps>
     <steps mode="data">
+        <step title="Data Integrity Step">
+            <integrity>Migration\Step\DataIntegrity\Integrity</integrity>
+        </step>
         <step title="EAV Step">
             <integrity>Migration\Step\Eav\Integrity</integrity>
             <data>Migration\Step\Eav\Data</data>
@@ -115,6 +118,7 @@
         <order_grids_document_groups_file>etc/ce-to-ce/order-grids-document-groups.xml.dist</order_grids_document_groups_file>
         <map_document_groups>etc/ce-to-ce/map-document-groups.xml.dist</map_document_groups>
         <class_map>etc/ce-to-ce/class-map.xml.dist</class_map>
+        <tier_price_map_file>etc/ce-to-ce/map-tier-price.xml.dist</tier_price_map_file>
         <!--
         In case bulk_size=0 it will be auto-detected for every document.
         -->

etc/ce-to-ce/1.7.0.0/map.xml.dist

@@ -838,6 +838,20 @@
                     <param name="entityTypeCode" value="catalog_category"/>
                 </handler>
             </transform>
+            <transform>
+                <field>catalog_category_entity_varchar.value</field>
+                <handler class="\Migration\Handler\SetValueAttributeCondition">
+                     <param name="attributeCode" value="custom_design"/>
+                     <param name="value" value="null"/>
+                </handler>
+            </transform>
+            <transform>
+                <field>catalog_category_entity_text.value</field>
+                <handler class="\Migration\Handler\SetValueAttributeCondition">
+                     <param name="attributeCode" value="custom_layout_update"/>
+                     <param name="value" value="null"/>
+                </handler>
+            </transform>
             <transform>
                 <field>catalog_product_entity_varchar.value</field>
                 <handler class="\Migration\Handler\ConvertEavValue">

etc/ce-to-ce/1.7.0.1/config.xml.dist

@@ -18,6 +18,9 @@
         </step>
     </steps>
     <steps mode="data">
+        <step title="Data Integrity Step">
+            <integrity>Migration\Step\DataIntegrity\Integrity</integrity>
+        </step>
         <step title="EAV Step">
             <integrity>Migration\Step\Eav\Integrity</integrity>
             <data>Migration\Step\Eav\Data</data>
@@ -115,6 +118,7 @@
         <order_grids_document_groups_file>etc/ce-to-ce/order-grids-document-groups.xml.dist</order_grids_document_groups_file>
         <map_document_groups>etc/ce-to-ce/map-document-groups.xml.dist</map_document_groups>
         <class_map>etc/ce-to-ce/class-map.xml.dist</class_map>
+        <tier_price_map_file>etc/ce-to-ce/map-tier-price.xml.dist</tier_price_map_file>
         <!--
         In case bulk_size=0 it will be auto-detected for every document.
         -->

etc/ce-to-ce/1.7.0.1/map.xml.dist

@@ -838,6 +838,20 @@
                     <param name="entityTypeCode" value="catalog_category"/>
                 </handler>
             </transform>
+            <transform>
+                <field>catalog_category_entity_varchar.value</field>
+                <handler class="\Migration\Handler\SetValueAttributeCondition">
+                     <param name="attributeCode" value="custom_design"/>
+                     <param name="value" value="null"/>
+                </handler>
+            </transform>
+            <transform>
+                <field>catalog_category_entity_text.value</field>
+                <handler class="\Migration\Handler\SetValueAttributeCondition">
+                     <param name="attributeCode" value="custom_layout_update"/>
+                     <param name="value" value="null"/>
+                </handler>
+            </transform>
             <transform>
                 <field>catalog_product_entity_varchar.value</field>
                 <handler class="\Migration\Handler\ConvertEavValue">

etc/ce-to-ce/1.7.0.2/config.xml.dist

@@ -18,6 +18,9 @@
         </step>
     </steps>
     <steps mode="data">
+        <step title="Data Integrity Step">
+            <integrity>Migration\Step\DataIntegrity\Integrity</integrity>
+        </step>
         <step title="EAV Step">
             <integrity>Migration\Step\Eav\Integrity</integrity>
             <data>Migration\Step\Eav\Data</data>
@@ -115,6 +118,7 @@
         <order_grids_document_groups_file>etc/ce-to-ce/order-grids-document-groups.xml.dist</order_grids_document_groups_file>
         <map_document_groups>etc/ce-to-ce/map-document-groups.xml.dist</map_document_groups>
         <class_map>etc/ce-to-ce/class-map.xml.dist</class_map>
+        <tier_price_map_file>etc/ce-to-ce/map-tier-price.xml.dist</tier_price_map_file>
         <!--
         In case bulk_size=0 it will be auto-detected for every document.
         -->

etc/ce-to-ce/1.7.0.2/map.xml.dist

@@ -838,6 +838,20 @@
                     <param name="entityTypeCode" value="catalog_category"/>
                 </handler>
             </transform>
+            <transform>
+                <field>catalog_category_entity_varchar.value</field>
+                <handler class="\Migration\Handler\SetValueAttributeCondition">
+                     <param name="attributeCode" value="custom_design"/>
+                     <param name="value" value="null"/>
+                </handler>
+            </transform>
+            <transform>
+                <field>catalog_category_entity_text.value</field>
+                <handler class="\Migration\Handler\SetValueAttributeCondition">
+                     <param name="attributeCode" value="custom_layout_update"/>
+                     <param name="value" value="null"/>
+                </handler>
+            </transform>
             <transform>
                 <field>catalog_product_entity_varchar.value</field>
                 <handler class="\Migration\Handler\ConvertEavValue">

etc/ce-to-ce/1.8.0.0/config.xml.dist

@@ -18,6 +18,9 @@
         </step>
     </steps>
     <steps mode="data">
+        <step title="Data Integrity Step">
+            <integrity>Migration\Step\DataIntegrity\Integrity</integrity>
+        </step>
         <step title="EAV Step">
             <integrity>Migration\Step\Eav\Integrity</integrity>
             <data>Migration\Step\Eav\Data</data>
@@ -115,6 +118,7 @@
         <order_grids_document_groups_file>etc/ce-to-ce/order-grids-document-groups.xml.dist</order_grids_document_groups_file>
         <map_document_groups>etc/ce-to-ce/map-document-groups.xml.dist</map_document_groups>
         <class_map>etc/ce-to-ce/class-map.xml.dist</class_map>
+        <tier_price_map_file>etc/ce-to-ce/map-tier-price.xml.dist</tier_price_map_file>
         <!--
         In case bulk_size=0 it will be auto-detected for every document.
         -->

etc/ce-to-ce/1.8.0.0/map.xml.dist

@@ -838,6 +838,20 @@
                     <param name="entityTypeCode" value="catalog_category"/>
                 </handler>
             </transform>
+            <transform>
+                <field>catalog_category_entity_varchar.value</field>
+                <handler class="\Migration\Handler\SetValueAttributeCondition">
+                     <param name="attributeCode" value="custom_design"/>
+                     <param name="value" value="null"/>
+                </handler>
+            </transform>
+            <transform>
+                <field>catalog_category_entity_text.value</field>
+                <handler class="\Migration\Handler\SetValueAttributeCondition">
+                     <param name="attributeCode" value="custom_layout_update"/>
+                     <param name="value" value="null"/>
+                </handler>
+            </transform>
             <transform>
                 <field>catalog_product_entity_varchar.value</field>
                 <handler class="\Migration\Handler\ConvertEavValue">

etc/ce-to-ce/1.8.1.0/config.xml.dist

@@ -18,6 +18,9 @@
         </step>
     </steps>
     <steps mode="data">
+        <step title="Data Integrity Step">
+            <integrity>Migration\Step\DataIntegrity\Integrity</integrity>
+        </step>
         <step title="EAV Step">
             <integrity>Migration\Step\Eav\Integrity</integrity>
             <data>Migration\Step\Eav\Data</data>
@@ -115,6 +118,7 @@
         <order_grids_document_groups_file>etc/ce-to-ce/order-grids-document-groups.xml.dist</order_grids_document_groups_file>
         <map_document_groups>etc/ce-to-ce/map-document-groups.xml.dist</map_document_groups>
         <class_map>etc/ce-to-ce/class-map.xml.dist</class_map>
+        <tier_price_map_file>etc/ce-to-ce/map-tier-price.xml.dist</tier_price_map_file>
         <!--
         In case bulk_size=0 it will be auto-detected for every document.
         -->