Closed Work Items not Migrating

[carnageX]

This is for issues: For questions on usage please use https://stackoverflow.com/questions/tagged/azure-devops-migration-tools and tag with azure-devops-migration-tools

Describe your issue:

I'm attempting to migrate a project from our on-prem ADOS to ADO (cloud), and succeeded, partially. It seems the Closed work items did not migrate. I've checked my config file, and I don't have the qualifier to check for ClosedDate = ''. I even specifically added a check where ClosedDate != '' in the query bit, and it still did not find the closed Work Items when I tried re-running the script.

I'm running v11.9.29.0 of the tool.

However, when running the script, I see this query in the logs:

[11:49:53 DBG] WorkItemQuery: ===========GetWorkItems=============
[11:49:53 DBG] WorkItemQuery: TeamProjectCollection: 
[11:49:53 DBG] WorkItemQuery: Query: SELECT [System.Id], [System.Tags] FROM WorkItems WHERE [System.TeamProject] = 'PROJECTNAME' AND  [Microsoft.VSTS.Common.ClosedDate] = '' AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan') ORDER BY [System.ChangedDate] desc
[11:49:53 DBG] WorkItemQuery: Paramiters: {"TeamProject": ""}
[11:49:53 DBG] WorkItemQuery: TeamProject: 
[11:50:02 INF] Replay all revisions of 96 work items?
[11:50:02 INF] Found target project as 
[11:50:02 INF] [FilterWorkItemsThatAlreadyExistInTarget] is enabled. Searching for work items that have already been migrated to the target...
[11:50:02 DBG] FilterExistingWorkItems: START |
[11:50:02 DBG] FilterByTarget: Query Execute...
[11:50:02 DBG] WorkItemQuery: ===========GetWorkItems=============
[11:50:02 DBG] WorkItemQuery: TeamProjectCollection: 
[11:50:02 DBG] WorkItemQuery: Query: SELECT [System.Id], [ReflectedWorkItemId] FROM WorkItems WHERE [System.TeamProject] = 'PROJECTNAME' AND  [Microsoft.VSTS.Common.ClosedDate] = '' AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan') ORDER BY [System.ChangedDate] desc
[11:50:02 DBG] WorkItemQuery: Paramiters: {"TeamProject": ""}
[11:50:02 DBG] WorkItemQuery: TeamProject: 
[11:51:19 DBG] FilterByTarget: ... query complete.
[11:51:19 DBG] FilterByTarget: Found 650 based on the WIQLQueryBit in the target system.

...

[11:51:20 DBG] FilterByTarget: After removing all found work items there are 0 remaining to be migrated.
[11:51:20 DBG] FilterByTarget: END
[11:51:20 INF] !! After removing all found work items there are 0 remaining to be migrated.

Describe any Exceptions:

No Exceptions

Source Details

• Source Version: DevOps Server 2019.0.1
• Source Language: Eng

Target Details

• Target Version: , Azure DevOps Services
• Target Language: Eng

I have completed the following:

• Enable Debug in the Logfile - You can set "LogLevel": "Debug" in the configuration file which will output more information to the log.
• Please specify the Source and Target environments above - Which versions are you migrating from/to Azure DevOps Server 2019, Azure DevOps Services, TFS 20xx.
• Attach the full Logfile from your last run - You can obtuse any of the data that you want, but it's really helpful to have the full log to see what lead up to the issue. Do not copy and paste the entire log in here! Attach the file to the issue!
• Attach the full Configuration file - You can obtuse any of the data that you want, but it's really helpful to have the full config. Do not copy and paste the entire log in here! Attach the file to the issue!

Log file: migrate.log

Config file:
configuration_redacted.txt

Many issues are due to edge cases and will need debugging in Visual Studio; we cant do that for you on your environment.

[skfd]

In attached config you are skipping WI that have ClosedDate:

"QueryBit": "AND [Microsoft.VSTS.Common.ClosedDate] != '' AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan')",

Use <> instead of != in config because it just throws away the exclamation point. Log says:

[17:05:11 DBG] WorkItemQuery: Query: SELECT [System.Id], [System.Tags] FROM WorkItems WHERE [System.TeamProject] = 'MyProject' AND [Microsoft.VSTS.Common.ClosedDate] = '' AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan') ORDER BY [System.ChangedDate] desc

[carnageX]

In attached config you are skipping WI that have ClosedDate:

"QueryBit": "AND [Microsoft.VSTS.Common.ClosedDate] != '' AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan')",

Use <> instead of != in config because it just throws away the exclamation point. Log says:

[17:05:11 DBG] WorkItemQuery: Query: SELECT [System.Id], [System.Tags] FROM WorkItems WHERE [System.TeamProject] = 'MyProject' AND [Microsoft.VSTS.Common.ClosedDate] = '' AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan') ORDER BY [System.ChangedDate] desc

I'll try this when I'm back in the office at work, thank you!

I got the != from an SO thread, and thought SQL still treated it as <>.

My initial config didn't even include that piece in the query bit, so why would it have not migrated closed items to begin with?

[skfd]

My initial config didn't even include that piece in the query bit, so why would it have not migrated closed items to begin with?

I would not worry about it, unless you have logs and config of initial run. So many issues ahead no reason to worry about past ones 😎

[carnageX]

I changed the != operator to <> and it still did not respect that change in the query.

Log line:

[09:49:36 DBG] WorkItemQuery: Query: SELECT [System.Id], [System.Tags] FROM WorkItems WHERE [System.TeamProject] = 'MyProject' AND  [Microsoft.VSTS.Common.ClosedDate] = '' AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan') ORDER BY [System.ChangedDate] desc

QueryBit from config:

"QueryBit": "AND [Microsoft.VSTS.Common.ClosedDate] <> '' AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan')",

[ced455]

Hello @carnageX I got the same issue than you with :

"WIQLQueryBit": "AND [Microsoft.VSTS.Common.ClosedDate] = '' AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan')", "WIQLOrderBit": "[System.ChangedDate] desc",

Did you found any workaround/solution to this problem ?

[carnageX]

Hello @carnageX I got the same issue than you with :

"WIQLQueryBit": "AND [Microsoft.VSTS.Common.ClosedDate] = '' AND [System.WorkItemType] NOT IN ('Test Suite', 'Test Plan')", "WIQLOrderBit": "[System.ChangedDate] desc",

Did you found any workaround/solution to this problem ?

No unfortunately I have not.

[ced455]

@carnageX

here is my work around :

Querry all the task that are in done state, then tag them with something unique, change the state to something else then run the migration.
once you are in your new env just query all tickets with the unique tag and change the state to done.

Hoppefully this will help !

[MrHinsh]

@carnageX you have "QueryBit" instead of "WIQLQueryBit".

Internally if "WIQLQueryBit" is not set then it is left as the default query.

[carnageX]

@carnageX you have "QueryBit" instead of "WIQLQueryBit".

Internally if "WIQLQueryBit" is not set then it is left as the default query.

This was my issue, thank you!

In addition to that, as of v11.9.37.0 of the tool, I had to add additional mappings in the FieldValueMapConfig for System.State.

"valueMapping": {
"Approved": "New",
"New": "New",
"Committed": "Active",
"In Progress": "Active",
"Active": "Active",
"To Do": "New",
"Done": "Closed",
"Resolved": "Resolved",
"Closed": "Closed",
"Removed": "Removed"
}