neurograce commited on
Commit
d1ef09b
·
verified ·
1 Parent(s): 754e72c

Update model card

Browse files
Files changed (1) hide show
  1. README.md +188 -0
README.md ADDED
@@ -0,0 +1,188 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: dynvision
4
+ language:
5
+ - en
6
+ tags:
7
+ - neuroscience
8
+ - vision
9
+ - recurrent-neural-networks
10
+ - pytorch
11
+ - pytorch-lightning
12
+ - dynamical-systems
13
+ - computational-neuroscience
14
+ - object-recognition
15
+ - temporal-processing
16
+ - imagenette
17
+ datasets:
18
+ - imagenette
19
+ - imagenet
20
+ - cifar10
21
+ - mnist
22
+ metrics:
23
+ - accuracy
24
+ - top-5-accuracy
25
+ - reaction-time
26
+ model-index:
27
+ - name: DyRCNN
28
+ results: []
29
+ ---
30
+
31
+ # DynVision — Trained Models and Evaluation Reports
32
+
33
+ This repository contains pre-trained model checkpoints and evaluation reports
34
+ from the [DynVision](https://github.com/Lindsay-Lab/DynVision) toolbox —
35
+ a modular framework for constructing and evaluating recurrent convolutional
36
+ neural networks (RCNNs) with biologically inspired temporal dynamics.
37
+
38
+ ## Model Description
39
+
40
+ DynVision implements visual network architectures where neural activity evolves
41
+ according to continuous-time differential equations with realistic timescales.
42
+ Recurrent connections within and across processing stages allow the network to
43
+ integrate information over time, producing dynamics that can be aligned with
44
+ properties of biological visual systems.
45
+
46
+ ### Architectures Included
47
+
48
+ | Architecture | Type | Description |
49
+ |-------------|------|-------------|
50
+ | **DyRCNNx8** | Recurrent | 8-layer dynamic RCNN with configurable recurrence types (full, self, depthwise, pointwise) and feedback/skip connections |
51
+ | **CorNet-RT** | Recurrent | CORnet model of the primate ventral visual stream with anatomically-inspired recurrent connections between areas V1, V2, V4, IT |
52
+ | **CordsNet** | Feedforward | Scale-invariant contour integration network with pretrained weights |
53
+
54
+ ### Training
55
+
56
+ - **Framework**: PyTorch Lightning with Snakemake workflow management
57
+ - **Data loading**: FFCV for high-throughput image loading
58
+ - **Optimizer**: Adam with cosine annealing
59
+ - **Mixed precision**: Automatic (AMP)
60
+ - **Seeds**: 7000–7003
61
+ - **Datasets**: Imagenette, ImageNet, CIFAR-10, MNIST
62
+
63
+ ### Evaluation Experiments
64
+
65
+ The reports directory contains evaluation results across multiple experimental
66
+ paradigms designed to probe temporal response properties:
67
+
68
+ - **contrast**: 9 CSV files
69
+ - **duration**: 9 CSV files
70
+ - **gaussiannoise**: 16 CSV files
71
+ - **gaussiannoiseffonly**: 11 CSV files
72
+ - **hundred**: 5 CSV files
73
+ - **interval**: 9 CSV files
74
+ - **response**: 52 CSV files
75
+ - **responseintermediate**: 12 CSV files
76
+ - **stability**: 9 CSV files
77
+ - **ten**: 4 CSV files
78
+
79
+ ## Repository Contents
80
+
81
+ | Item | Count |
82
+ |------|-------|
83
+ | Model configs | 190 |
84
+ | Report files | 136 |
85
+ | Total size | 20005 MB |
86
+
87
+ ```
88
+ models/
89
+ {architecture}/
90
+ {model_config}/
91
+ {dataset}/
92
+ trained-best.pt # Best checkpoint weights
93
+ trained-epoch=N.pt # Per-epoch checkpoints
94
+ trained.pt.config.yaml # Training hyperparameters
95
+
96
+ reports/
97
+ {experiment}/
98
+ {model_config}/
99
+ {data_group}/
100
+ {run_hash}/
101
+ test_data.csv # Evaluation metrics
102
+ ```
103
+
104
+ ## Usage
105
+
106
+ ### Loading a Pre-trained Model
107
+
108
+ ```python
109
+ from huggingface_hub import hf_hub_download
110
+ from dynvision.utils.model_utils import load_model_and_weights
111
+
112
+ # Download a specific checkpoint
113
+ checkpoint_path = hf_hub_download(
114
+ repo_id="neurograce/DynVision",
115
+ filename="models/DyRCNNx8/DyRCNNx8:tsteps=20+dt=2+...+_7000/imagenette/trained-best.pt",
116
+ repo_type="model",
117
+ )
118
+
119
+ # Load weights into the model architecture
120
+ model = load_model_and_weights(
121
+ model_name="DyRCNNx8",
122
+ weights_path=checkpoint_path,
123
+ )
124
+ ```
125
+
126
+ ### Accessing Evaluation Reports
127
+
128
+ ```python
129
+ import pandas as pd
130
+ from huggingface_hub import hf_hub_download
131
+
132
+ # Download a report CSV
133
+ report_path = hf_hub_download(
134
+ repo_id="neurograce/DynVision",
135
+ filename="reports/contrast/DyRCNNx8:tsteps=20+...+_7000/imagenette:all_trained-best/test_data.csv",
136
+ repo_type="model",
137
+ )
138
+
139
+ df = pd.read_csv(report_path)
140
+ print(df.head())
141
+ ```
142
+
143
+ ### Downloading the Full Model Directory
144
+
145
+ ```python
146
+ from huggingface_hub import snapshot_download
147
+
148
+ # Download all files for offline use
149
+ local_path = snapshot_download(
150
+ repo_id="neurograce/DynVision",
151
+ repo_type="model",
152
+ local_dir="./dynvision_models",
153
+ )
154
+ ```
155
+
156
+ ## Intended Uses
157
+
158
+ - Reproducing experimental results from the DynVision manuscript
159
+ - Benchmarking biologically-inspired recurrent architectures
160
+ - Studying temporal dynamics and response properties of visual networks
161
+ - Transfer learning and feature extraction with recurrence-augmented backbones
162
+
163
+ ## Limitations
164
+
165
+ - Models were trained on specific image datasets (Imagenette, ImageNet, CIFAR-10,
166
+ MNIST) and may not generalize to other domains without fine-tuning.
167
+ - Recurrent dynamics are sensitive to temporal parameters (τ, dt, t_recurrence);
168
+ inference with different timestep configurations may produce unexpected behavior.
169
+ - Per-epoch checkpoints capture training trajectories but not all epochs are
170
+ guaranteed to be stable minima.
171
+
172
+ ## Citation
173
+
174
+ If you use these models or the DynVision toolbox in your research, please cite:
175
+
176
+ ```bibtex
177
+ @article{gutzen2025dynvision,
178
+ title={DynVision: A Modular Toolbox for Biologically Plausible Recurrent Visual Networks},
179
+ author={Gutzen, Robin and others},
180
+ journal={bioRxiv},
181
+ year={2025},
182
+ doi={10.1101/2025.08.11.669756}
183
+ }
184
+ ```
185
+
186
+ ## License
187
+
188
+ This repository is distributed under the [MIT License](https://github.com/Lindsay-Lab/DynVision/blob/main/LICENSE).