Microsoft Dynamics AX 2012 Data Migration Framework Beta 2.0 is now available on Information source


Microsoft Dynamics AX 2012 Data Migration Framework Beta 2.0 is now available on Information source.

Download Link : https://informationsource.dynamics.com//RFPServicesOnline/Rfpservicesonline.aspx?ToolDocName=Microsoft+Dynamics+AX+2012+Data+Migration+Framework+Beta+2.0%7cQJ4JEM76642V-8-1005

Besides the already rich feature set, some of the key new features which have been added in this release are below –

 

  1. ODBC as Source – with this it is possible to import data using ODBC.
  2. AX as Source – It supports export/import , copy company for Data migration Framework entities.
  3. New entity types – Direct Table and Composite Entity.  
  4. Parallel execution support from Staging to Target.
  5. Service Interface – DMF can be executed by external applications
  6. Error handling enhancements – skipping error rows, and detailed logs.
  7. Number sequence support.
  8. Removed requirement to install SSIS on AOS .
  9. SQL 2012 support

I will add details on the above feature set soon.

 

 

Comments (67)

  1. Hi Mudit,

    Thanks for the info, appreciate your valuable effort.

    I wanted to check if the DMF now supports SQL 2012 or not?.

  2. Thanks! Yes SQL 2012 support is added in this version.

  3. Srini says:

    Hi Mudit,

    I’m getting “One or more conflicting model elements already exists in an installed model.”  While importing model(beta 2)?

    Thanks

  4. Hi Srini

    Can you please use /conflict:Push option with axutil? We have moved DMF from USR to FPK layer. Looks like you are installing on feature pack , we are planning to have different model files per Ax version , at the mopment the above workarround would move conflicted objects to patch layer

  5. Srini says:

    Thanks for the quick reply. Now getting "The model contains a customization of a configuration key. the model cannot be imported because you can overlayer a configuration key from the patching layer only".

  6. Hi Srini,

    we faced similar issues. I had to delete the configuration key, do a Axutil delete /model:DMF, and recreate all SQL Tables to get it running.

    @Mudit: thx for the update. the error handling is much better!

    looking forward to the documentation. I am eager to know

    • how to " export/import , copy company for Data migration Framework entities"

    • what to do with the new entity types

    • how to use ODBC as Source !

  7. Derek says:

    Where does it state that SQL 2012 is supported?

  8. Hi Derek

    Yes i can confirm SQL 2012 is supported, once you install you will notice that as it would explicitly ask for SQL 2008 or SQL 2012.

  9. Hari says:

    Hi Iam getting this error while installing a Data Migration Framework Beta in shell "The pipeline has been stopped."

  10. Hi Hari, you need to use the /conflict:Push option with axutil or -conflict push with powershell as described above by Mudit.

  11. Adil says:

    Hi,

    During the installation process, I got the "Conflicting issue" as almost everybody, issue which can be solved using the workaround  /conflict:Push

    However, I'm noticing in the installed models window 2 lines concerning DMF:

    FPP      Data Migration Frame (Conflict 1)      1.0.0.0    

    FPK      Data Migration Framework                1.0.0.5

    Please advice?

  12. Keven Walz says:

    Hi,

    when I install the DMF Service on a standalone SQL Server 2012 with SSIS installed (not VPC image), i'll get at least the error message "There is a problem with this installer package. A program run as part of the setup did not finish as expected. Contact your support personnel or package vendor."

    So, in this situation what is to do??

  13. Hi Adil

    The conflicted objects are related to Menu,etc. As i said in previous post we would be shipping multiple models with different versions of Ax, so that issue would be resolved then.

  14. Hi Keven

    There is an issue with DMF service installer in a specific scenario. If you are on a 64-bit box and dont have VS 2010 you might see an error related to installer. It is unable to register one of the dlls related to error handling. We will be publishing detailed work around for it.

    For now –

    I. Either install VS 2010, and then install DMF service

    OR

    II. Install DMF service, you would get an error. Ignore and follow the steps below –

    1.Install the Microsoft Windows SDK for Windows and .NET Framework 4 from http://www.microsoft.com/…/details.aspx.

    2.On the Installation Options page, select the following options, and then complete the installation.

    •Under .NET Development, select Tools

    •Under Redistributable Packages, select Microsoft Visual C++ 2010

    3.Open a command prompt with Run as administrator rights.

    4.Depending on which version of SQL Server is in your environment, run one of the following commands.

    SQL Server 2012 <System Drive>Program FilesMicrosoft SDKsWindowsv7.1binNETFX 4.0 Toolsgacutil.exe" -i "C:Program FilesMicrosoft Dynamics AX 2012 Data Migration Framework Service (Beta)Microsoft.Dynamics.AX.DMF.DMFErrorDescription.dll"

    SQL Server 20008 <System Drive>Program FilesMicrosoft SDKsWindowsv7.1bingacutil.exe" -i "C:Program FilesMicrosoft Dynamics AX 2012 Data Migration Framework Service (Beta)Microsoft.Dynamics.AX.DMF.DMFErrorDescription.dll"

    5.Start the Microsoft Dynamics AX 2012 Data Migration Framework service

  15. Adil says:

    Hi,

    I'm getting the following error when trying to preview my source file (demo files):

    "DMF service is unavailable. Please contact the system administrator."

    However, my DMF service is running correctly on the SQL Server side …

    Am I missing something?

    Thanks for your help

  16. Hi Adil

    Can you please verify the serivce is up and accessible from ax client and aos box. Try to open this on IE

    http://[HOSTMACHINE]:7000/DMFService/DMFServiceHelper.svc

    Change hostmachine to machine where DMF service is running.

  17. steve347 says:

    Hello,

    The CIL compilation is showing these errors:

    Finished pass 1 at 06/11/2012 10:16:41

    Error when loading the method. Type: CustomerTransaction_CustSettlementLine, Method: new

    System.NullReferenceException: Object reference not set to an instance of an object.

      at Microsoft.Dynamics.Ax.Xpp.ILGenerator.BuildConstructor(TypeBuilder typeBuilder, XmlNode methodNode)

      at Microsoft.Dynamics.Ax.Xpp.ILGenerator.BuildMethod(TypeBuilder typeBuilder, XmlNode methodNode)

      at Microsoft.Dynamics.Ax.Xpp.ILGenerator.LoadMethods(XmlNode classNode, TypeBuilder typeBuilder)

      at Microsoft.Dynamics.Ax.Xpp.ILGenerator.GenerateXppModule()

    … the same with

    Error when loading the method. Type: CustomerTransaction_CustSettlement, Method: new

    Error when loading the method. Type: CustomerTransaction_CustTransOpenLine, Method: new

    Error when loading the method. Type: CustomerTransaction_CustTransOpen, Method: new

    Error when loading the method. Type: CustomerTransaction_CustTrans, Method: new

    Error when loading the method. Type: CustomerTransaction, Method: new

    Errors: 6

    Warnings: 0

  18. Keven Walz says:

    Hi Steve,

    This is an error regarding to Public Sector. The DMF axmodel overwrites the macro "DataContainerTypes". Just compare the macro with fpk and fpp layer and take the following code into var or usr layer:

    //<PubSect>

    #AxdCustomerTransactionDCT

    #AxdAdvancedLedgerEntryDCT

    //</PubSect>

    Just compile and generate CIL – it should work.

  19. HariKiran Varre says:

    Yes you are right, also after bringing the macro to upper layer, right click on each object thatthe error is showing and compile them individually, and also delete the CIL failed log files present in C:Program FilesMicrosoft Dynamics AX60ServerMicrosoftDynamicsAX1binXppIL  following path and do full CIL, this has to work

    Thanks.

  20. Christian says:

    Hi!

    I have an isse after installing the DMF on my local image.

    When installing i used the  /conflict:Push commando and have the same 2 lines as Adil regarding the DMF.

    But my problem is when trying to create a new custom entity for migration. In the Table drop down list, i get the following errormessage:

    Cannot select a record in Model element (DMFModelElement). ModelElementType: 0.

    The SQL database has issued an error.

    SQL error description: [Microsoft][SQL Server Native Client 10.0][SQL Server]Invalid object name 'DMFMODELELEMENT'.

    SQL statement: SELECT T1.NAME,T1.ELEMENTTYPE,T1.RECID FROM DMFMODELELEMENT T1 WHERE ((ELEMENTTYPE=?) AND  NOT ((NAME LIKE ? ESCAPE '' ))) ORDER BY T1.RECID

    Anyone had the same issue when installing?

    Christian

  21. HariKiran Varre says:

    Hi Christian,

    This error might arise due to improper database synchronization, re synchronize the database from System Administration->Database->Sql Administration after synchronizing close and open the client and then try. and there is a possibility that if the database synchronization is not done after deleting the old modelfile and befor importing the new model file this sought of errors will arise.

    Thanks.

  22. HariKiran Varre says:

    Hi All,

    Has anyone explored on creating Table Entity/Composite Entitys's with DMF 2.0, n also like to know how ti import data with ODBC as a source.

    Thanks.

  23. Wim Drummen says:

    First of all we are very pleased with the new Data Migration Framework Beta 2.0. We see a lot of opportunities to use this tool in the future.

    A lot of our customers in the Food Industry work with batch numbers (inventBatchId) and pallet-ID’s (wMSPalletID) in order to store and track & trace their inventory. We therefore would like to have the possibility to migrate an inventory file were batch numbers and pallet-ID’s are included, and subsequently generated automatically in AX 2012 if not already present.

    For batch numbers we would like to have the opportunity to define the production date, shelf advice date, best before date and expiration date in the inventory file. We would also like to have the possibility to leave these fields blank, in that case AX 2012 should take the transaction date as the production date and calculate the other dates with the setup of the item on the item card. For pallet-ID’s we would like to have the opportunity to define the pallet-ID number and pallet type.

    For both batch numbers and pallet-ID’s we would like to generate numbers automatically if they are not defined.

    My collegue Ernest Wensink has already spoken with Mudit Mittal (solution architect) regarding this topic on the Dynamics AX Technical conference 2012, and he told him to add these extra fields.

  24. Fadi Ghrawi says:

    Hi,

    Any clue if we can import dimension now, like color , size and configuration?

    Regards

  25. Hi,

    Hoping someone might be able to help. I have a test instance of AX 2012 (kernel 6.0.1108.670, application 6.0.1108.670, solution 6.0.1108.670). I am trying to install DMF beta 2 and successfully used the /conflict:Push option with axutil to import the axmodel file.

    Everything completed successfully in the upgrade checklist until attempting the Compile into .NET Framework CIL which failed with 6 errors. The Compiler output error description was the same for each error being: "CIL generation: Object reference not set to an instance of an object"

    Path = XppIL

    Method/Property name = XppIL

    Diagnositc ID = Err:351

    Infolog returned the error message "The CIL generator found errors and could not save the new assembly"

    Any assistance would be most appreciated.

  26. Oscar says:

    When i press the button "Preview Source File " i get this error:  Could not create object CLRObject

    Any idea?

    Thanks

  27. Oscar says:

    Hi,

    In another ambient, when i press the button "Preview Source File " i get this error: Could not load file or assembly 'Microsoft.SqlServer.DTSRuntimeWrap, Version=10.0.0.0, Culture=neutral, PublicKeyToken=89845dcd8080cc91' or one of its dependencies. The system cannot find the file specified.

    I have DMF beta 2

    Any idea?

    Thanks

  28. HariKiran varre says:

    Hi Oscar,

    In the DMF module got setup->Data Migration Framework parameters-> and select a directory on which the dmf service installed or the directory that has service access and try again this should work

    Thanks

  29. HariKiran varre says:

    Hi Oscar,

    The Assembly missing error might be due to improper installation of the .exe setup that you installed for DMF 2.0 and also there is a possibilty that if you already installed DMF Previous Version, you should Uninstall the previous DMF software  and then install DMF 2.0 .exe setup.

  30. HariKiran Varre says:

    Hi John ChristianAustralia,

    This is an error regarding to Public Sector. The DMF axmodel overwrites the macro "DataContainerTypes". Just compare the macro with fpk and fpp layer and take the following code into var or usr layer:

    //<PubSect>

    #AxdCustomerTransactionDCT

    #AxdAdvancedLedgerEntryDCT

    //</PubSect>

    after bringing the macro to upper layer, right click on each object thatthe error is showing and compile them individually, and also delete the CIL failed log files present in C:Program FilesMicrosoft Dynamics AX60ServerMicrosoftDynamicsAX1binXppIL  following path

    Just compile and generate Full CIL – it should work.

  31. UdhayAnand AVB says:

    What are the benefits, if I use DMF instead of Excel add-ins??

  32. Rob says:

    Am trying to import items using the new tool and using odbc/sql source table

    Would be great if we could start with a working example source table record – nightmare trying to create one with valid data items that work

  33. JC says:

    I have the same issue as JohnChristianAustralia and have not been able to resolve it with any of the tips. Has any one experienced and resolved this issue?

  34. AV says:

    Has Anyone gotten the following error when clicking on "Preview Source File":

    Info: Error updating derived component properties

    Error: Error updating derived component properties-Exception from HRESULT: 0xC0048021

  35. Bill says:

    Hi Mudit Mittal,

    We tried to install DMF on one hardware (Develop Box) with two AOSs installed. But, when install DMF for 2nd AOS by just import Modle file, after importing Model file to 2nd AOS, our previous DMF works for 1st AOS were failed to run. And we could not setup DMF Parameter, it was failed on 'Validate Service Account access the directory":

    -Assembly containing type Microsoft.Dynamics.AX.DMF.DriverHelper.DMFOdbcDriver is not referenced.

    -Object 'CLRObject' could not be created

    My first question, is it OK to install DMF on a server with multiple AX AOSs installed?

    My 2nd question is, if above answer is positive, what is the "Right" method or process to install DMF for 2nd AOS?

    Thanks a lot!

    Bill

  36. Suba says:

    We have installed DMF.DMF was working fine,CIL generation is also done successful.

    Now it started throughing error with creditcardnumber table,were that table is changed into del_creditcardtable.

    please suggest us any problem related DMF tool version related to AX2012 R2.

  37. William Giesbrecht says:

    Hi all, excellent blogging!  I have the same problem as John ChristianAustralia.  I am new to Dynamics AX 2012 R2.  Could someone help explain HariKiran Varre's recommendation to compare the macro fpk to fpp layer?  

    What I tried was to remove the public sector key as this client doesn't need this configuration.  That didn't help.

  38. I should mention that I did run a FULL CIL compile.

  39. Teja_M says:

    Hi all,  I am trying to allocate path for Data Migration Frame work in parameters setting but i was stopped with the following error 's.

    ->Assembly containing type Microsoft.Dynamics.AX.DMF.DriverHelper.DMFOdbcDriver is not referenced.

    ->Object 'CLRObject' could not be created

    could some one help me in solving this,Thanks in advance

  40. Teja_M – can you please confirm you installed DMF service component correctly? And correct service host was mentioned during installation?

  41. Regarding DMF Beta 2.0 compatibility with AX R2. DMF as a framework works with all versions of AX 2012. However the model file for DMf was released before R2, so you would see overlayering and entity schema issues. There are ways to workaround those issues, however we are working on next release which will have official model for DMF R2.

  42. Daniel Guenter says:

    When using an ODBC data source (sql 2012), all of the source columns are listed as type "string" and I cannot map any price/cost fields.

  43. Randall says:

    Hi everyone.

    I'm installing DMF on a Windows Server 2008 R2 Standard Service Pack 1 and using Dynamics AX 2012 R2 and DMF Beta 2.

    After installing, and restarting the service, and the AOS, the client isn't compiling. The screen freezes showing the compilation options before I even try to tell it to Compile and Sinchronize.

    I did whats posted everywhere else, verified the service is running, and also that the DLLs are present. I even register the DLLs again just in case and everything went normal but still I am not able to compile and screen freezes before choosing from compilation options. Any help will be so much appreciated.

  44. Meinrad Baur says:

    Hi all,

    we also get an error when we building the ODBC connection:

    configuration:

    • AX2012 R2 with SQLSERVER2012 WIN_Server_2012
    • Cleint: W7

    • DMF Beta 2

    On the server I can access via ODBC to a SQL Server2012 DB. It's OK so far.

    My problem is that I need to access an Oracle DB. On the server, I have not the Ora-odbc driver installed. So I tried my luck on the client (W7).

    Settings in DMF:

    DNSType: SystemDSN

    DNS Location: customer

    Name: pull-down, then I get the following error:

    Auf die Assembly, die Typ Microsoft.Dynamics.AX.DMF.DriverHelper.DMFOdbcDriver enthält, wird nicht verwiesen.

    Objekt 'CLRObject' konnte nicht erstellt werden.

    Wath can I do?

    Thanks for your help.

    greeting

    Meinrad

  45. Ptadip says:

    I have same problem with Teja_M

    "the following error appear while setup share directory" anyone can help ?

    ->Assembly containing type Microsoft.Dynamics.AX.DMF.DriverHelper.DMFOdbcDriver is not referenced.

    ->Object 'CLRObject' could not be created

  46. HariKiran Varre says:

    Hi Mudit,

    I imported the R2 model fileto one of my R2 Ax instance, but found the labels description has not come up kindly let me know how could i solve this

  47. Steve Robinson says:

    Hi Mudit,

    I attended your session on the Data Import/Export Framework at Convergence this year and was very impressed with the tool.  I am excited to get started with the tool.  I am running into a problem with the installation, during the prerequisite check:

    Gacutil utility four registering .NET 4.0 assembly missing

    I have done some web searching and one possible solution seems to be to install Visual Studio on my SQL Server, which I am not totally on board with.  Any other suggestions?

    Thanks

    Steve

  48. Hi Steve

    The VS workarround was for Beta 2.0 version, for RTM version you dont need. Please install windows 7 SDK and windows 8 SDK ( in sequence).  Depending on your OS and SQL version, it needs to register using gacutil.  Please share SQL version and OS details, so i can tell you exactly what is missing.

  49. Hi HariKiran

    For label issue on R2, I tried but i am unable to repro. Could be related to your environment. Can you try cleaning the old ALD files before importing the model?

  50. In DMF parameters , when click validate button for the directory i have a an error like this.

    ->Assembly containing type Microsoft.Dynamics.AX.DMF.DriverHelper.DMFOdbcDriver is not referenced.

    ->Object 'CLRObject' could not be created

    anyone knows why? Please help….

  51. Problem –

    Hi Probobab/Teja,

    Assembly containing type Microsoft.Dynamics.AX.DMF.DriverHelper.DMFOdbcDriver is not referenced.

    ->Object 'CLRObject' could not be created

    Tested solution-

    I have also faced similar kind of issue. This is due to installation of DMF tool in multiple AOS scenerio in single physical server.Generally in one AOS it will run fine, and you will face issue in another AOS.

    You have to go to the C:Program FilesMicrosoft Dynamics AX60ServerDynamicsAXbin folder of your 2nd AOS(DMF giving error) and search for all DMF dlls; it will not be there.You have to copy from the C:Program FilesMicrosoft Dynamics AX60ServerDynamicsAXbin folder of 1st AOS(all DMF.dll files)and drop into the 2nd AOS specific folder—>AOS restart.Now it will validate the shared folder and dMF will work.

    Hope it solves your issue.

    community.dynamics.com/…/195791.aspx

    Prasenjit

  52. also pls dont forget to restart the dmf service in server

    prasenjit

  53. also copy the dmfconfig and dmfclientconfig file from the 1st aos C:Program FilesMicrosoft Dynamics AX60ServerDynamicsAXbin  folder to the 2nd one and restart AOS.

  54. Support for multiple AOS is there in the last release, you dont need to copy files manually. Please make sure you use the latest release.

  55. Prasenjit Ghosh says:

    Hi Mudit,

    Gacutil utility four registering .NET 4.0 assembly missing- My OS is Windows server 2008 R2 and SQL Server is 2012.

    Please let me know what is the workaround for this problem.I am installing the RTM version of DMF tool in production environment.

    Prasenjit

  56. @Prasenjit – can you please confirm if you have windows SDK 7.1 installed? Also , if it is English OS?

  57. Ax tech says:

    Hi Mudit,

    can you tell me any benchmark that we have for importing the product with variant using the DMF.

    thanks.

  58. Avtar says:

    I have read that this tool is the best option to copy a "template configured company" to another company.  An example:  I have completely configured the finance modules for one company and now I need to close this template company to 40 other companies.  How can I use the DMF tool without creating custom entities for the parameter settings and other tables in each modules?  Any guidance would be appreciated.

    Thanks

  59. ajinkya says:

    I want to install DMF in multiple instance in ax2012 r2 is it that possible…

  60. R Ranjan Kumar says:

    Hi Mudit,

    I am using AX 2012 R2 CU7. During excel import , I am getting the following error

    The version of Microsoft Excel is not supported.-The 'Microsoft.ACE.OLEDB.12.0' provider is not registered on the local machine.

    Any suggestion.

    Regards,

    Ranjan

  61. Premjit says:

    Hi Mudit,

    I am facing the following when trying to export from staging to file in batch.

    It runs fine for manual run but faces the following when run inbatch.

    System.NullReferenceException: Object reference not set to an instance of an object.

      at Dynamics.Ax.Application.DMFStagingToSourceFileWriter.Run() in DMFStagingToSourceFileWriter.run.xpp:line 9

      at Dynamics.Ax.Application.BatchRun.runJobStaticCode(Int64 batchId) in BatchRun.runJobStaticCode.xpp:line 54

      at Dynamics.Ax.Application.BatchRun.runJobStatic(Int64 batchId) in BatchRun.runJobStatic.xpp:line 13

      at BatchRun::runJobStatic(Object[] )

      at Microsoft.Dynamics.Ax.Xpp.ReflectionCallHelper.MakeStaticCall(Type type, String MethodName, Object[] parameters)

      at BatchIL.taskThreadEntry(Object threadArg)

  62. Raman says:

    Hello,

    I'm on a single AOS installation and still getting this error when I try to export to CSV file from a staging table: Assembly containing type Microsoft.Dynamics.AX.DMF.DriverHelper.DMFOdbcDriver is not referenced.

    Object 'CLRObject' could not be created

    File path is invalid

    Can anyone help?

    Thank you

  63. Tim says:

    Hi Mudit,

    I am running AX2012 R2 CU7, and it is missing entities, I believe there should be 150 entities, however, my DMFEntity table contains only 71 records.  Is there some form of regeneration that needs to take place?

    Thank you

  64. Uday says:

    Composite entity with SQL2014 getting below error : no issue with SQL2012 ? Are we missing any components ? is composite entity supported with SQL2014

    Exception from HRESULT : 0xC0048021

    for additional warnings or errors, please check the log

    any help is appreciated.

  65. Pradhan says:

    Hi Mudit,

    When importing data through excel using DMF(Ax 2012 R2), i am getting below error when doing a preview file.

    "The version of Microsoft excel is not supported".

    I have MS Excel 2010(32 bit installed) and I have installed 64 bit supported driver. Also created the user DSN for 32 bit as well 64 bit. Previously i was getting the same error during generate source mapping but after doing the 64 bit supported driver installation it got resolved. But now i am stuck with preview file.

    Please help.

    Thanks

    Pradhan