Skip to content

Commit

Permalink
[DATALAD RUNCMD] Get latest validation reports with a summary
Browse files Browse the repository at this point in the history
=== Do not change lines below ===
{
 "chain": [],
 "cmd": "duct dandisets-linkml-status --include-unpublished --dandi-instance dandi -l INFO",
 "exit": 0,
 "extra_inputs": [],
 "inputs": [],
 "outputs": [],
 "pwd": "."
}
^^^ Do not change lines above ^^^
  • Loading branch information
DANDI Bot committed Nov 11, 2024
1 parent edf6228 commit 8fc9443
Show file tree
Hide file tree
Showing 14 changed files with 4,614 additions and 173 deletions.
1 change: 1 addition & 0 deletions .duct/logs/2024.11.11T06.54.34-3527_info.json
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"command": "dandisets-linkml-status --include-unpublished --dandi-instance dandi -l INFO", "system": {"cpu_total": 4, "memory_total": 16757342208, "hostname": "fv-az1542-37", "uid": 1001, "user": "runner"}, "env": {}, "gpu": null, "duct_version": "0.8.0", "schema_version": "0.2.0", "execution_summary": {"exit_code": 0, "command": "dandisets-linkml-status --include-unpublished --dandi-instance dandi -l INFO", "logs_prefix": ".duct/logs/2024.11.11T06.54.34-3527_", "wall_clock_time": 255.8856463432312, "peak_rss": 2892443648, "average_rss": 1639567634.141733, "peak_vsz": 3330502656, "average_vsz": 1989150397.4803157, "peak_pmem": 17.2, "average_pmem": 9.733070866141734, "peak_pcpu": 86.8, "average_pcpu": 84.68425196850399, "num_samples": 254, "num_reports": 6, "start_time": 1731308074.0844765, "end_time": 1731308329.9701228}, "output_paths": {"stdout": ".duct/logs/2024.11.11T06.54.34-3527_stdout", "stderr": ".duct/logs/2024.11.11T06.54.34-3527_stderr", "usage": ".duct/logs/2024.11.11T06.54.34-3527_usage.json", "info": ".duct/logs/2024.11.11T06.54.34-3527_info.json", "prefix": ".duct/logs/2024.11.11T06.54.34-3527_"}}
3,574 changes: 3,574 additions & 0 deletions .duct/logs/2024.11.11T06.54.34-3527_stderr

Large diffs are not rendered by default.

719 changes: 719 additions & 0 deletions .duct/logs/2024.11.11T06.54.34-3527_stdout

Large diffs are not rendered by default.

6 changes: 6 additions & 0 deletions .duct/logs/2024.11.11T06.54.34-3527_usage.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
{"timestamp": "2024-11-11T06:54:34.094910+00:00", "num_samples": 1, "processes": {"3530": {"pcpu": 0.0, "pmem": 0.0, "rss": 9306112, "vsz": 17379328, "timestamp": "2024-11-11T06:54:34.094910+00:00", "etime": "00:00", "stat": {"Rs": 1}, "cmd": "/opt/hostedtoolcache/Python/3.12.7/x64/bin/python /opt/hostedtoolcache/Python/3.12.7/x64/bin/dandisets-linkml-status --include-unpublished --dandi-instance dandi -l INFO"}}, "totals": {"pmem": 0.0, "pcpu": 0.0, "rss": 9306112, "vsz": 17379328}, "averages": {"rss": 9306112, "vsz": 17379328, "pmem": 0.0, "pcpu": 0.0, "num_samples": 1}}
{"timestamp": "2024-11-11T06:55:34.642687+00:00", "num_samples": 60, "processes": {"3530": {"pcpu": 85.5, "pmem": 5.1, "rss": 861495296, "vsz": 1290539008, "timestamp": "2024-11-11T06:55:34.642687+00:00", "etime": "01:00", "stat": {"Rs": 37, "Ss": 11, "Rsl": 12}, "cmd": "/opt/hostedtoolcache/Python/3.12.7/x64/bin/python /opt/hostedtoolcache/Python/3.12.7/x64/bin/dandisets-linkml-status --include-unpublished --dandi-instance dandi -l INFO"}}, "totals": {"pmem": 5.1, "pcpu": 85.5, "rss": 861495296, "vsz": 1290539008}, "averages": {"rss": 488108646.3999999, "vsz": 583447347.1999999, "pmem": 2.8616666666666655, "pcpu": 83.81000000000003, "num_samples": 60}}
{"timestamp": "2024-11-11T06:56:34.143221+00:00", "num_samples": 59, "processes": {"3530": {"pcpu": 85.6, "pmem": 9.3, "rss": 1573679104, "vsz": 2006941696, "timestamp": "2024-11-11T06:56:34.143221+00:00", "etime": "02:00", "stat": {"Rsl": 52, "Ssl": 7}, "cmd": "/opt/hostedtoolcache/Python/3.12.7/x64/bin/python /opt/hostedtoolcache/Python/3.12.7/x64/bin/dandisets-linkml-status --include-unpublished --dandi-instance dandi -l INFO"}}, "totals": {"pmem": 9.3, "pcpu": 85.6, "rss": 1573679104, "vsz": 2006941696}, "averages": {"rss": 1219292698.0338988, "vsz": 1649852346.5762715, "pmem": 7.228813559322037, "pcpu": 85.16949152542374, "num_samples": 59}}
{"timestamp": "2024-11-11T06:57:34.669567+00:00", "num_samples": 60, "processes": {"3530": {"pcpu": 85.8, "pmem": 13.6, "rss": 2294292480, "vsz": 2732494848, "timestamp": "2024-11-11T06:57:34.669567+00:00", "etime": "03:00", "stat": {"Rsl": 54, "Ssl": 6}, "cmd": "/opt/hostedtoolcache/Python/3.12.7/x64/bin/python /opt/hostedtoolcache/Python/3.12.7/x64/bin/dandisets-linkml-status --include-unpublished --dandi-instance dandi -l INFO"}}, "totals": {"pmem": 13.6, "pcpu": 85.8, "rss": 2294292480, "vsz": 2732494848}, "averages": {"rss": 1930958506.6666665, "vsz": 2366381533.8666663, "pmem": 11.471666666666666, "pcpu": 85.52166666666666, "num_samples": 60}}
{"timestamp": "2024-11-11T06:58:34.182493+00:00", "num_samples": 59, "processes": {"3530": {"pcpu": 85.9, "pmem": 17.2, "rss": 2892443648, "vsz": 3330502656, "timestamp": "2024-11-11T06:58:34.182493+00:00", "etime": "04:00", "stat": {"Ssl": 6, "Rsl": 45, "Rs": 8}, "cmd": "/opt/hostedtoolcache/Python/3.12.7/x64/bin/python /opt/hostedtoolcache/Python/3.12.7/x64/bin/dandisets-linkml-status --include-unpublished --dandi-instance dandi -l INFO"}}, "totals": {"pmem": 17.2, "pcpu": 85.9, "rss": 2892443648, "vsz": 3330502656}, "averages": {"rss": 2643946617.4915247, "vsz": 3078012927.9999995, "pmem": 15.72542372881356, "pcpu": 85.24237288135595, "num_samples": 59}}
{"timestamp": "2024-11-11T06:58:49.314028+00:00", "num_samples": 15, "processes": {"3530": {"pcpu": 86.8, "pmem": 17.2, "rss": 2892443648, "vsz": 3287601152, "timestamp": "2024-11-11T06:58:49.314028+00:00", "etime": "04:15", "stat": {"Rs": 15}, "cmd": "/opt/hostedtoolcache/Python/3.12.7/x64/bin/python /opt/hostedtoolcache/Python/3.12.7/x64/bin/dandisets-linkml-status --include-unpublished --dandi-instance dandi -l INFO"}}, "totals": {"pmem": 17.2, "pcpu": 86.8, "rss": 2892443648, "vsz": 3287601152}, "averages": {"rss": 2891048277.3333335, "vsz": 3286202504.5333333, "pmem": 17.19333333333333, "pcpu": 86.37333333333335, "num_samples": 15}}
4 changes: 2 additions & 2 deletions dandi-reports/001174/draft/metadata.json
Original file line number Diff line number Diff line change
Expand Up @@ -52,8 +52,8 @@
"identifier": "RRID:SCR_015242"
}
],
"numberOfBytes": 51504878148,
"numberOfFiles": 15,
"numberOfBytes": 101357623408,
"numberOfFiles": 17,
"numberOfSubjects": 2,
"variableMeasured": [
"OpticalChannel",
Expand Down
4 changes: 2 additions & 2 deletions dandi-reports/001174/draft/metadata.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -14,8 +14,8 @@ assetsSummary:
schemaKey: MeasurementTechniqueType
- name: surgical technique
schemaKey: MeasurementTechniqueType
numberOfBytes: 51504878148
numberOfFiles: 15
numberOfBytes: 101357623408
numberOfFiles: 17
numberOfSubjects: 2
schemaKey: AssetsSummary
species:
Expand Down
25 changes: 25 additions & 0 deletions dandi-reports/001253/draft/linkml_validation_errs.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
[
{
"type": "jsonschema validation",
"severity": "ERROR",
"message": "{'name': 'Uchida, Naoshige', 'email': 'uchida@mcb.harvard.edu', 'roleName': ['dcite:ContactPerson'], 'schemaKey': 'Person', 'affiliation': [], 'includeInCitation': True} is not of type 'string' in /contributor/0",
"instance_index": 0,
"instantiates": "Dandiset",
"context": [],
"source": {
"message": "{'name': 'Uchida, Naoshige', 'email': 'uchida@mcb.harvard.edu', 'roleName': ['dcite:ContactPerson'], 'schemaKey': 'Person', 'affiliation': [], 'includeInCitation': True} is not of type 'string'",
"absolute_path": [
"contributor",
0
],
"absolute_schema_path": [
"properties",
"contributor",
"items",
"type"
],
"validator": "type",
"validator_value": "string"
}
}
]
22 changes: 22 additions & 0 deletions dandi-reports/001253/draft/linkml_validation_errs.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
- context: []
instance_index: 0
instantiates: Dandiset
message: '{''name'': ''Uchida, Naoshige'', ''email'': ''uchida@mcb.harvard.edu'',
''roleName'': [''dcite:ContactPerson''], ''schemaKey'': ''Person'', ''affiliation'':
[], ''includeInCitation'': True} is not of type ''string'' in /contributor/0'
severity: ERROR
source:
absolute_path:
- contributor
- 0
absolute_schema_path:
- properties
- contributor
- items
- type
message: '{''name'': ''Uchida, Naoshige'', ''email'': ''uchida@mcb.harvard.edu'',
''roleName'': [''dcite:ContactPerson''], ''schemaKey'': ''Person'', ''affiliation'':
[], ''includeInCitation'': True} is not of type ''string'''
validator: type
validator_value: string
type: jsonschema validation
42 changes: 42 additions & 0 deletions dandi-reports/001253/draft/metadata.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@
{
"id": "DANDI:001253/draft",
"url": "https://dandiarchive.org/dandiset/001253/draft",
"name": "An opponent striatal circuit for distributional reinforcement learning",
"access": [
{
"status": "dandi:OpenAccess",
"schemaKey": "AccessRequirements"
}
],
"license": [
"spdx:CC-BY-4.0"
],
"version": "draft",
"citation": "Uchida, Naoshige (2024) An opponent striatal circuit for distributional reinforcement learning (Version draft) [Data set]. DANDI archive. https://dandiarchive.org/dandiset/001253/draft",
"schemaKey": "Dandiset",
"identifier": "DANDI:001253",
"repository": "https://dandiarchive.org",
"contributor": [
{
"name": "Uchida, Naoshige",
"email": "uchida@mcb.harvard.edu",
"roleName": [
"dcite:ContactPerson"
],
"schemaKey": "Person",
"affiliation": [],
"includeInCitation": true
}
],
"dateCreated": "2024-11-10T15:51:35.745964+00:00",
"description": "Machine learning research has achieved large performance gains on a wide range of tasks by expanding the learning target from mean rewards to entire probability distributions of rewards \u2014 an approach known as distributional reinforcement learning (RL). The mesolimbic dopamine system is thought to underlie RL in the mammalian brain by updating a representation of mean value in the striatum, but little is known about whether, where, and how neurons in this circuit encode information about higher-order moments of reward distributions. To fill this gap, we used high-density probes (Neuropixels) to record striatal activity from mice performing a classical conditioning task in which reward mean, reward variance, and stimulus identity were independently manipulated. In contrast to traditional RL accounts, we found robust evidence for abstract encoding of variance in the striatum. Remarkably, chronic ablation of dopamine inputs disorganized these distributional representations in the striatum without interfering with mean value coding. Two-photon calcium imaging and optogenetics revealed that the two major classes of striatal medium spiny neurons \u2014 D1 and D2 MSNs \u2014 contributed to this code by preferentially encoding the right and left tails of the reward distribution, respectively. We synthesize these findings into a new model of the striatum and mesolimbic dopamine that harnesses the opponency between D1 and D2 MSNs to reap the computational benefits of distributional RL. ",
"assetsSummary": {
"schemaKey": "AssetsSummary",
"numberOfBytes": 0,
"numberOfFiles": 0
},
"schemaVersion": "0.6.8",
"manifestLocation": [
"https://api.dandiarchive.org/api/dandisets/001253/versions/draft/assets/"
]
}
49 changes: 49 additions & 0 deletions dandi-reports/001253/draft/metadata.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,49 @@
access:
- schemaKey: AccessRequirements
status: dandi:OpenAccess
assetsSummary:
numberOfBytes: 0
numberOfFiles: 0
schemaKey: AssetsSummary
citation: Uchida, Naoshige (2024) An opponent striatal circuit for distributional
reinforcement learning (Version draft) [Data set]. DANDI archive. https://dandiarchive.org/dandiset/001253/draft
contributor:
- affiliation: []
email: uchida@mcb.harvard.edu
includeInCitation: true
name: Uchida, Naoshige
roleName:
- dcite:ContactPerson
schemaKey: Person
dateCreated: '2024-11-10T15:51:35.745964+00:00'
description: "Machine learning research has achieved large performance gains on a
wide range of tasks by expanding the learning target from mean rewards to entire
probability distributions of rewards \u2014 an approach known as distributional
reinforcement learning (RL). The mesolimbic dopamine system is thought to underlie
RL in the mammalian brain by updating a representation of mean value in the striatum,
but little is known about whether, where, and how neurons in this circuit encode
information about higher-order moments of reward distributions. To fill this gap,
we used high-density probes (Neuropixels) to record striatal activity from mice
performing a classical conditioning task in which reward mean, reward variance,
and stimulus identity were independently manipulated. In contrast to traditional
RL accounts, we found robust evidence for abstract encoding of variance in the striatum.
Remarkably, chronic ablation of dopamine inputs disorganized these distributional
representations in the striatum without interfering with mean value coding. Two-photon
calcium imaging and optogenetics revealed that the two major classes of striatal
medium spiny neurons \u2014 D1 and D2 MSNs \u2014 contributed to this code by preferentially
encoding the right and left tails of the reward distribution, respectively. We synthesize
these findings into a new model of the striatum and mesolimbic dopamine that harnesses
the opponency between D1 and D2 MSNs to reap the computational benefits of distributional
RL. "
id: DANDI:001253/draft
identifier: DANDI:001253
license:
- spdx:CC-BY-4.0
manifestLocation:
- https://api.dandiarchive.org/api/dandisets/001253/versions/draft/assets/
name: An opponent striatal circuit for distributional reinforcement learning
repository: https://dandiarchive.org
schemaKey: Dandiset
schemaVersion: 0.6.8
url: https://dandiarchive.org/dandiset/001253/draft
version: draft
1 change: 1 addition & 0 deletions dandi-reports/001253/draft/pydantic_validation_errs.json
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
[]
1 change: 1 addition & 0 deletions dandi-reports/001253/draft/pydantic_validation_errs.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
[]
Loading

0 comments on commit 8fc9443

Please sign in to comment.