Archive frozen research checkpoints v1 batch 1

LICENSE

@@ -0,0 +1,179 @@
+                                 Apache License
+                           Version 2.0, January 2004
+                        http://www.apache.org/licenses/
+
+   TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
+
+   1. Definitions.
+
+      "License" shall mean the terms and conditions for use, reproduction,
+      and distribution as defined by Sections 1 through 9 of this document.
+      "Licensor" shall mean the copyright owner or entity authorized by
+      the copyright owner that is granting the License.
+      "Legal Entity" shall mean the union of the acting entity and all
+      other entities that control, are controlled by, or are under common
+      control with that entity. For the purposes of this definition,
+      "control" means (i) the power, direct or indirect, to cause the
+      direction or management of such entity, whether by contract or
+      otherwise, or (ii) ownership of fifty percent (50%) or more of the
+      outstanding shares, or (iii) beneficial ownership of such entity.
+      "You" (or "Your") shall mean an individual or Legal Entity
+      exercising permissions granted by this License.
+
+      "Source" form shall mean the preferred form for making modifications,
+      including but not limited to software source code, documentation
+      source, and configuration files.
+      "Object" form shall mean any form resulting from mechanical
+      transformation or translation of a Source form, including but
+      not limited to compiled object code, generated documentation,
+      and conversions to other media types.
+
+      "Work" shall mean the work of authorship, whether in Source or
+      Object form, made available under the License, as indicated by a
+      copyright notice that is included in or attached to the work
+      (an example is provided in the Appendix below).
+      "Derivative Works" shall mean any work, whether in Source or Object
+      form, that is based on (or derived from) the Work and for which the
+      editorial revisions, annotations, elaborations, or other modifications
+      represent, as a whole, an original work of authorship. For the purposes
+      of this License, Derivative Works shall not include works that remain
+      separable from, or merely link (or bind by name) to the interfaces of,
+      the Work and Derivative Works thereof.
+      "Contribution" shall mean any work of authorship, including
+      the original version of the Work and any modifications or additions
+      to that Work or Derivative Works thereof, that is intentionally
+      submitted to Licensor for inclusion in the Work by the copyright owner
+      or by an individual or Legal Entity authorized to submit on behalf of
+      the copyright owner. For the purposes of this definition, "submitted"
+      means any form of electronic, verbal, or written communication sent
+      to the Licensor or its representatives, including but not limited to
+      communication on electronic mailing lists, source code control systems,
+      and issue tracking systems that are managed by, or on behalf of, the
+      Licensor for the purpose of discussing and improving the Work, but
+      excluding communication that is conspicuously marked or otherwise
+      designated in writing by the copyright owner as "Not a Contribution."
+      "Contributor" shall mean Licensor and any individual or Legal Entity
+      on behalf of whom a Contribution has been received by Licensor and
+      subsequently incorporated within the Work.
+   2. Grant of Copyright License. Subject to the terms and conditions of
+      this License, each Contributor hereby grants to You a perpetual,
+      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+      copyright license to reproduce, prepare Derivative Works of,
+      publicly display, publicly perform, sublicense, and distribute the
+      Work and such Derivative Works in Source or Object form.
+   3. Grant of Patent License. Subject to the terms and conditions of
+      this License, each Contributor hereby grants to You a perpetual,
+      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+      (except as stated in this section) patent license to make, have made,
+      use, offer to sell, sell, import, and otherwise transfer the Work,
+      where such license applies only to those patent claims licensable
+      by such Contributor that are necessarily infringed by their
+      Contribution(s) alone or by combination of their Contribution(s)
+      with the Work to which such Contribution(s) was submitted. If You
+      institute patent litigation against any entity (including a
+      cross-claim or counterclaim in a lawsuit) alleging that the Work
+      or a Contribution incorporated within the Work constitutes direct
+      or contributory patent infringement, then any patent licenses
+      granted to You under this License for that Work shall terminate
+      as of the date such litigation is filed.
+   4. Redistribution. You may reproduce and distribute copies of the
+      Work or Derivative Works thereof in any medium, with or without
+      modifications, and in Source or Object form, provided that You
+      meet the following conditions:
+
+      (a) You must give any other recipients of the Work or
+          Derivative Works a copy of this License; and
+
+      (b) You must cause any modified files to carry prominent notices
+          stating that You changed the files; and
+      (c) You must retain, in the Source form of any Derivative Works
+          that You distribute, all copyright, patent, trademark, and
+          attribution notices from the Source form of the Work,
+          excluding those notices that do not pertain to any part of
+          the Derivative Works; and
+      (d) If the Work includes a "NOTICE" text file as part of its
+          distribution, then any Derivative Works that You distribute must
+          include a readable copy of the attribution notices contained
+          within such NOTICE file, excluding those notices that do not
+          pertain to any part of the Derivative Works, in at least one
+          of the following places: within a NOTICE text file distributed
+          as part of the Derivative Works; within the Source form or
+          documentation, if provided along with the Derivative Works; or,
+          within a display generated by the Derivative Works, if and
+          wherever such third-party notices normally appear. The contents
+          of the NOTICE file are for informational purposes only and
+          do not modify the License. You may add Your own attribution
+          notices within Derivative Works that You distribute, alongside
+          or as an addendum to the NOTICE text from the Work, provided
+          that such additional attribution notices cannot be construed
+          as modifying the License.
+      You may add Your own copyright statement to Your modifications and
+      may provide additional or different license terms and conditions
+      for use, reproduction, or distribution of Your modifications, or
+      for any such Derivative Works as a whole, provided Your use,
+      reproduction, and distribution of the Work otherwise complies with
+      the conditions stated in this License.
+   5. Submission of Contributions. Unless You explicitly state otherwise,
+      any Contribution intentionally submitted for inclusion in the Work
+      by You to the Licensor shall be under the terms and conditions of
+      this License, without any additional terms or conditions.
+      Notwithstanding the above, nothing herein shall supersede or modify
+      the terms of any separate license agreement you may have executed
+      with Licensor regarding such Contributions.
+   6. Trademarks. This License does not grant permission to use the trade
+      names, trademarks, service marks, or product names of the Licensor,
+      except as required for reasonable and customary use in describing the
+      origin of the Work and reproducing the content of the NOTICE file.
+   7. Disclaimer of Warranty. Unless required by applicable law or
+      agreed to in writing, Licensor provides the Work (and each
+      Contributor provides its Contributions) on an "AS IS" BASIS,
+      WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+      implied, including, without limitation, any warranties or conditions
+      of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
+      PARTICULAR PURPOSE. You are solely responsible for determining the
+      appropriateness of using or redistributing the Work and assume any
+      risks associated with Your exercise of permissions under this License.
+   8. Limitation of Liability. In no event and under no legal theory,
+      whether in tort (including negligence), contract, or otherwise,
+      unless required by applicable law (such as deliberate and grossly
+      negligent acts) or agreed to in writing, shall any Contributor be
+      liable to You for damages, including any direct, indirect, special,
+      incidental, or consequential damages of any character arising as a
+      result of this License or out of the use or inability to use the
+      Work (including but not limited to damages for loss of goodwill,
+      work stoppage, computer failure or malfunction, or any and all
+      other commercial damages or losses), even if such Contributor
+      has been advised of the possibility of such damages.
+   9. Accepting Warranty or Additional Liability. While redistributing
+      the Work or Derivative Works thereof, You may choose to offer,
+      and charge a fee for, acceptance of support, warranty, indemnity,
+      or other liability obligations and/or rights consistent with this
+      License. However, in accepting such obligations, You may act only
+      on Your own behalf and on Your sole responsibility, not on behalf
+      of any other Contributor, and only if You agree to indemnify,
+      defend, and hold each Contributor harmless for any liability
+      incurred by, or claims asserted against, such Contributor by reason
+      of your accepting any such warranty or additional liability.
+   END OF TERMS AND CONDITIONS
+
+   APPENDIX: How to apply the Apache License to your work.
+      To apply the Apache License to your work, attach the following
+      boilerplate notice, with the fields enclosed by brackets "[]"
+      replaced with your own identifying information. (Don't include
+      the brackets!)  The text should be enclosed in the appropriate
+      comment syntax for the file format. We also recommend that a
+      file or class name and description of purpose be included on the
+      same "printed page" as the copyright notice for easier
+      identification within third-party archives.
+   Copyright 2023 Tri Dao, Albert Gu
+
+   Licensed under the Apache License, Version 2.0 (the "License");
+   you may not use this file except in compliance with the License.
+   You may obtain a copy of the License at
+
+       http://www.apache.org/licenses/LICENSE-2.0
+   Unless required by applicable law or agreed to in writing, software
+   distributed under the License is distributed on an "AS IS" BASIS,
+   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+   See the License for the specific language governing permissions and
+   limitations under the License.

NOTICE

@@ -0,0 +1,32 @@
+Research checkpoint archival notice, 2026-10-07
+=============================================
+
+Project-generated research weights and new archive metadata are made available
+under Apache License Version 2.0 at the user's explicit request to open-source
+the weights. Existing source files are preserved byte-for-byte in selected
+subsets; this notice does not grant a new license to pre-existing source or
+relicense any third-party work.
+
+Zoology benchmark data generation, training/evaluation shell and comparator:
+  https://github.com/HazyResearch/zoology
+  pinned commit 1ad20d193b6113cae1e8f3c655c300d7b4b3f4bb
+  Apache-2.0 repository license; upstream per-file notices remain applicable.
+  No complete upstream tree is redistributed here.
+
+Mamba-3 source-derived FP32 SISO subset:
+  https://github.com/state-spaces/mamba
+  pinned commit e9594ce1c732d97440f0332fdc43170a2294dbfa
+  Copyright (c) 2025/2026, Dao AI Lab, Goombalab.
+  Copyright (c) 2024, Tri Dao (normalization source).
+  Copyright 2023 Tri Dao, Albert Gu (captured LICENSE appendix).
+  Original source-derived subset attribution LICENSE/NOTICE/PROVENANCE files
+  are retained in the corresponding exact-source subset.
+
+The historical subset NOTICE described an upstream NOTICE verification gap.
+Subsequent pinned recursive Git tree verification found no separately named
+upstream NOTICE/COPYING and verified the LICENSE blob; its recorded reference
+is results/benchmark_setup_20261002/mamba_source_license_verification_20261002_v1.json.
+This later fact does not clear every historical full source ZIP or vendor tree.
+
+Official pretrained state-spaces/mamba3-mimo-1.5b weights are referenced, not
+redistributed or granted a new license by this archive.

README.md

@@ -0,0 +1,76 @@
+---
+license: apache-2.0
+tags:
+- research
+- state-space-model
+- mqar
+- reproducibility
+---
+
+# Mamba research: frozen project checkpoints
+
+This is a public artifact archive, not a ready-to-use pretrained language model.
+The Apache-2.0 grant covers the project-produced checkpoint weights and newly
+authored archive metadata only. Existing source and third-party material retain
+their original license/copyright status; see `SOURCE_AND_LICENSE_SCOPE.md`.
+
+## What is included
+
+- 20 completed, full-budget single-cell runs on pinned official Zoology MQAR
+  data: project endpoint (7), project retimed (6), attention comparator (6),
+  and a partial FP32 SISO reference (1).
+- Five historical endpoint mechanism checkpoints, training seeds 11--15,
+  from a bespoke supplementary key/value diagnostic.
+- Terminal checkpoints, exact-source **minimal subsets**, effective configs,
+  provenance, completion/summary evidence, original and published-file hashes.
+
+The terminal selection is archival, not selection of favorable validation
+checkpoints. Completed runs with poor outcomes are retained. These are only
+selected historical runs, not all preregistered experiments or the entire
+evaluation record. Initial/epoch/recovery weights, raw arrays and datasets stay
+local and are not deleted. No training or model execution was performed while
+preparing this archive.
+
+## Architecture and research limits
+
+Project endpoint/retimed models are **not complete official Mamba-3**. The SISO
+reference excludes MIMO and other features explicitly documented in its captured
+`PROVENANCE.json`. Full-budget MQAR cells are not full reproduction of the
+original Mamba-3 paper or proof of generalization, novelty or broad superiority.
+The bespoke mechanism checkpoints are supplementary diagnostics, not standard
+benchmark substitutes. The original-paper reproduction gate remains unmet;
+known gradient/cache/numerical and full training/protocol limitations remain.
+
+The official 1.5B MIMO checkpoint is **not mirrored or relabeled**. Use the
+pinned upstream reference in `UPSTREAM_REFERENCES.json`. That checkpoint is
+separate from the project models archived here.
+
+## File layout and retrieval
+
+Each directory under `checkpoints/` has one completed terminal `.pt`, its
+config/provenance, and `source_snapshot_minimal.zip`. The subset zip is newly
+derived from the run's archived source and includes only hash-verified selected
+files. It is **not the original full source archive**. Its subset manifest
+records omitted paths; original source ZIPs remain local because earlier
+whole-vendor license audits found unresolved third-party redistribution issues.
+
+Download a selected file with `huggingface_hub.hf_hub_download`, pin the archive
+commit, and compare SHA256 with `ARCHIVE_MANIFEST.json` before loading. `.pt`
+files may include optimizer/scheduler/RNG metadata and are not advertised as
+exact continuation states. Use a trusted PyTorch environment and
+`torch.load(..., map_location="cpu", weights_only=True)` where supported; this
+archive does not authorize unsafe pickle loading and does not certify the
+checkpoint-loading/runtime gate. Do not assume Transformers `from_pretrained`
+compatibility.
+
+The exact original metadata hashes and checkpoint bytes are retained. Published
+metadata is a derived JSON rendering with local user/workspace paths redacted.
+Local interrupted/failed experiments and prior manuscripts were not rewritten.
+
+## Attribution
+
+See `UPSTREAM_REFERENCES.json`, `ZOOLOGY_LICENSE.md`, `NOTICE`, and the
+per-checkpoint source subset manifests. The research source repository is
+https://github.com/guangxiangdebizi/mamba-research . This archive is not endorsed
+by the Mamba or Zoology authors. No scientific claim follows from successful
+hosting or hash verification alone.

SOURCE_AND_LICENSE_SCOPE.md

@@ -0,0 +1,25 @@
+# Source and license boundary
+
+The root Apache-2.0 license applies to the newly released **project checkpoint
+weights and new archive metadata**. It is not a blanket grant for every file
+inside historical source snapshots, and not a relicense of upstream models.
+
+Published minimal source ZIPs contain hash-verified project code from the exact
+archived run, and (for the SISO run) its source-derived Apache-2.0 subset with
+LICENSE, NOTICE and provenance. Existing copyright/license headers are retained.
+Pre-existing project source without a license is provided as provenance, not
+silently assigned a new redistribution license. Consult its owner before reuse.
+
+Full vendor source archives are excluded because a prior audit identified
+unclosed Facebook BSD/Idiap and NumPy/PyTorch/Mamba notice/license issues in
+some complete historical archives. Neither the original archives nor historical
+audit findings were changed. Complete third-party repositories must be obtained
+from their pinned primary sources and used under their original licenses.
+
+The archive records exact-source subset hashes, the original ZIP hash, all
+omitted paths, original and public metadata hashes, and pinned upstream source
+identity. A subset is not represented as a full source snapshot. Dependencies,
+upstream evaluator/runtime, original datasets and environment are not bundled.
+
+The archive neither certifies the entire repository's license compliance nor
+claims that a published checkpoint is the official Mamba-3 architecture.

UPSTREAM_REFERENCES.json

@@ -0,0 +1,20 @@
+{
+  "official_pretrained_weight_not_mirrored": {
+    "repo": "state-spaces/mamba3-mimo-1.5b",
+    "revision": "bc6b5d0f7994fe4cb3478242e92da8daf9ee29ec",
+    "filename": "pytorch_model.bin",
+    "source_url": "https://huggingface.co/state-spaces/mamba3-mimo-1.5b/resolve/bc6b5d0f7994fe4cb3478242e92da8daf9ee29ec/pytorch_model.bin",
+    "actual_sha256": "139c09e9728d1f10ac7f4354d2ae29aaca41851a954aedd8f6728c05aeb6c744",
+    "actual_bytes": 2994280907
+  },
+  "zoology_source": {
+    "repository": "https://github.com/HazyResearch/zoology",
+    "revision": "1ad20d193b6113cae1e8f3c655c300d7b4b3f4bb",
+    "license": "Apache-2.0 plus per-file upstream notices/licenses; entire vendor tree not redistributed"
+  },
+  "mamba_source": {
+    "repository": "https://github.com/state-spaces/mamba",
+    "revision": "e9594ce1c732d97440f0332fdc43170a2294dbfa",
+    "license": "Apache-2.0; source-derived SISO subset includes LICENSE/NOTICE"
+  }
+}

ZOOLOGY_LICENSE.md

@@ -0,0 +1,201 @@
+                                 Apache License
+                           Version 2.0, January 2004
+                        http://www.apache.org/licenses/
+
+   TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
+
+   1. Definitions.
+
+      "License" shall mean the terms and conditions for use, reproduction,
+      and distribution as defined by Sections 1 through 9 of this document.
+
+      "Licensor" shall mean the copyright owner or entity authorized by
+      the copyright owner that is granting the License.
+
+      "Legal Entity" shall mean the union of the acting entity and all
+      other entities that control, are controlled by, or are under common
+      control with that entity. For the purposes of this definition,
+      "control" means (i) the power, direct or indirect, to cause the
+      direction or management of such entity, whether by contract or
+      otherwise, or (ii) ownership of fifty percent (50%) or more of the
+      outstanding shares, or (iii) beneficial ownership of such entity.
+
+      "You" (or "Your") shall mean an individual or Legal Entity
+      exercising permissions granted by this License.
+
+      "Source" form shall mean the preferred form for making modifications,
+      including but not limited to software source code, documentation
+      source, and configuration files.
+
+      "Object" form shall mean any form resulting from mechanical
+      transformation or translation of a Source form, including but
+      not limited to compiled object code, generated documentation,
+      and conversions to other media types.
+
+      "Work" shall mean the work of authorship, whether in Source or
+      Object form, made available under the License, as indicated by a
+      copyright notice that is included in or attached to the work
+      (an example is provided in the Appendix below).
+
+      "Derivative Works" shall mean any work, whether in Source or Object
+      form, that is based on (or derived from) the Work and for which the
+      editorial revisions, annotations, elaborations, or other modifications
+      represent, as a whole, an original work of authorship. For the purposes
+      of this License, Derivative Works shall not include works that remain
+      separable from, or merely link (or bind by name) to the interfaces of,
+      the Work and Derivative Works thereof.
+
+      "Contribution" shall mean any work of authorship, including
+      the original version of the Work and any modifications or additions
+      to that Work or Derivative Works thereof, that is intentionally
+      submitted to Licensor for inclusion in the Work by the copyright owner
+      or by an individual or Legal Entity authorized to submit on behalf of
+      the copyright owner. For the purposes of this definition, "submitted"
+      means any form of electronic, verbal, or written communication sent
+      to the Licensor or its representatives, including but not limited to
+      communication on electronic mailing lists, source code control systems,
+      and issue tracking systems that are managed by, or on behalf of, the
+      Licensor for the purpose of discussing and improving the Work, but
+      excluding communication that is conspicuously marked or otherwise
+      designated in writing by the copyright owner as "Not a Contribution."
+
+      "Contributor" shall mean Licensor and any individual or Legal Entity
+      on behalf of whom a Contribution has been received by Licensor and
+      subsequently incorporated within the Work.
+
+   2. Grant of Copyright License. Subject to the terms and conditions of
+      this License, each Contributor hereby grants to You a perpetual,
+      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+      copyright license to reproduce, prepare Derivative Works of,
+      publicly display, publicly perform, sublicense, and distribute the
+      Work and such Derivative Works in Source or Object form.
+
+   3. Grant of Patent License. Subject to the terms and conditions of
+      this License, each Contributor hereby grants to You a perpetual,
+      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+      (except as stated in this section) patent license to make, have made,
+      use, offer to sell, sell, import, and otherwise transfer the Work,
+      where such license applies only to those patent claims licensable
+      by such Contributor that are necessarily infringed by their
+      Contribution(s) alone or by combination of their Contribution(s)
+      with the Work to which such Contribution(s) was submitted. If You
+      institute patent litigation against any entity (including a
+      cross-claim or counterclaim in a lawsuit) alleging that the Work
+      or a Contribution incorporated within the Work constitutes direct
+      or contributory patent infringement, then any patent licenses
+      granted to You under this License for that Work shall terminate
+      as of the date such litigation is filed.
+
+   4. Redistribution. You may reproduce and distribute copies of the
+      Work or Derivative Works thereof in any medium, with or without
+      modifications, and in Source or Object form, provided that You
+      meet the following conditions:
+
+      (a) You must give any other recipients of the Work or
+          Derivative Works a copy of this License; and
+
+      (b) You must cause any modified files to carry prominent notices
+          stating that You changed the files; and
+
+      (c) You must retain, in the Source form of any Derivative Works
+          that You distribute, all copyright, patent, trademark, and
+          attribution notices from the Source form of the Work,
+          excluding those notices that do not pertain to any part of
+          the Derivative Works; and
+
+      (d) If the Work includes a "NOTICE" text file as part of its
+          distribution, then any Derivative Works that You distribute must
+          include a readable copy of the attribution notices contained
+          within such NOTICE file, excluding those notices that do not
+          pertain to any part of the Derivative Works, in at least one
+          of the following places: within a NOTICE text file distributed
+          as part of the Derivative Works; within the Source form or
+          documentation, if provided along with the Derivative Works; or,
+          within a display generated by the Derivative Works, if and
+          wherever such third-party notices normally appear. The contents
+          of the NOTICE file are for informational purposes only and
+          do not modify the License. You may add Your own attribution
+          notices within Derivative Works that You distribute, alongside
+          or as an addendum to the NOTICE text from the Work, provided
+          that such additional attribution notices cannot be construed
+          as modifying the License.
+
+      You may add Your own copyright statement to Your modifications and
+      may provide additional or different license terms and conditions
+      for use, reproduction, or distribution of Your modifications, or
+      for any such Derivative Works as a whole, provided Your use,
+      reproduction, and distribution of the Work otherwise complies with
+      the conditions stated in this License.
+
+   5. Submission of Contributions. Unless You explicitly state otherwise,
+      any Contribution intentionally submitted for inclusion in the Work
+      by You to the Licensor shall be under the terms and conditions of
+      this License, without any additional terms or conditions.
+      Notwithstanding the above, nothing herein shall supersede or modify
+      the terms of any separate license agreement you may have executed
+      with Licensor regarding such Contributions.
+
+   6. Trademarks. This License does not grant permission to use the trade
+      names, trademarks, service marks, or product names of the Licensor,
+      except as required for reasonable and customary use in describing the
+      origin of the Work and reproducing the content of the NOTICE file.
+
+   7. Disclaimer of Warranty. Unless required by applicable law or
+      agreed to in writing, Licensor provides the Work (and each
+      Contributor provides its Contributions) on an "AS IS" BASIS,
+      WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+      implied, including, without limitation, any warranties or conditions
+      of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
+      PARTICULAR PURPOSE. You are solely responsible for determining the
+      appropriateness of using or redistributing the Work and assume any
+      risks associated with Your exercise of permissions under this License.
+
+   8. Limitation of Liability. In no event and under no legal theory,
+      whether in tort (including negligence), contract, or otherwise,
+      unless required by applicable law (such as deliberate and grossly
+      negligent acts) or agreed to in writing, shall any Contributor be
+      liable to You for damages, including any direct, indirect, special,
+      incidental, or consequential damages of any character arising as a
+      result of this License or out of the use or inability to use the
+      Work (including but not limited to damages for loss of goodwill,
+      work stoppage, computer failure or malfunction, or any and all
+      other commercial damages or losses), even if such Contributor
+      has been advised of the possibility of such damages.
+
+   9. Accepting Warranty or Additional Liability. While redistributing
+      the Work or Derivative Works thereof, You may choose to offer,
+      and charge a fee for, acceptance of support, warranty, indemnity,
+      or other liability obligations and/or rights consistent with this
+      License. However, in accepting such obligations, You may act only
+      on Your own behalf and on Your sole responsibility, not on behalf
+      of any other Contributor, and only if You agree to indemnify,
+      defend, and hold each Contributor harmless for any liability
+      incurred by, or claims asserted against, such Contributor by reason
+      of your accepting any such warranty or additional liability.
+
+   END OF TERMS AND CONDITIONS
+
+   APPENDIX: How to apply the Apache License to your work.
+
+      To apply the Apache License to your work, attach the following
+      boilerplate notice, with the fields enclosed by brackets "[]"
+      replaced with your own identifying information. (Don't include
+      the brackets!)  The text should be enclosed in the appropriate
+      comment syntax for the file format. We also recommend that a
+      file or class name and description of purpose be included on the
+      same "printed page" as the copyright notice for easier
+      identification within third-party archives.
+
+   Copyright 2021 The Meerkat Team.
+
+   Licensed under the Apache License, Version 2.0 (the "License");
+   you may not use this file except in compliance with the License.
+   You may obtain a copy of the License at
+
+       http://www.apache.org/licenses/LICENSE-2.0
+
+   Unless required by applicable law or agreed to in writing, software
+   distributed under the License is distributed on an "AS IS" BASIS,
+   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+   See the License for the specific language governing permissions and
+   limitations under the License.

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_attention_s12_lr4e4_paced_v1_background/status_started.json

@@ -0,0 +1,30 @@
+{
+  "args": {
+    "allow_full": true,
+    "architecture": "upstream_attention",
+    "batch_delay_seconds": 0.1,
+    "chunk": 32,
+    "cpu_threads": 4,
+    "data_seed": 123,
+    "device": "cuda",
+    "heads": 4,
+    "implementation": "stable",
+    "lr": 0.00046415888336127773,
+    "native_failure_artifact": "results\\benchmark_setup_20261002\\windows_native_seed_failure.json",
+    "output_dir": "results\\zoology_mqar\\v100_full_iclr24_L64_P4_attention_s12_lr4e4_paced_v1_background",
+    "profile": "full",
+    "seed": 12,
+    "seq_len": 64,
+    "state_size": 16,
+    "upstream": "<workspace>\\.cache\\upstream\\zoology",
+    "width": 64
+  },
+  "status": "started",
+  "time_utc": "2026-10-02T18:18:32.427905+00:00",
+  "upstream": {
+    "clean": true,
+    "commit": "1ad20d193b6113cae1e8f3c655c300d7b4b3f4bb",
+    "path": "<workspace>\\.cache\\upstream\\zoology",
+    "status": ""
+  }
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_attention_s13_lr4e4_paced_v1_background/checkpoint_final.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a01e3c07ec8b7f8fbb2500bb5140e603b3cc46548ea5df0e1712af7dd870c79b
+size 6953712

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_attention_s13_lr4e4_paced_v1_background/data_generation_provenance.json

@@ -0,0 +1,47 @@
+{
+  "actual_split_seeds": {
+    "test": [
+      3062119789
+    ],
+    "train": [
+      843828734
+    ]
+  },
+  "concurrency": "No concurrent data generation in this process",
+  "deviation": "Only prepare_data scope: absent np.random.randint dtype becomes np.int64; explicit dtype preserved",
+  "expected_randomstate_int64_split_seeds": {
+    "test": [
+      3062119789
+    ],
+    "train": [
+      843828734
+    ]
+  },
+  "preserved_native_failure": {
+    "path": "<workspace>\\results\\benchmark_setup_20261002\\windows_native_seed_failure.json",
+    "sha256": "f9f84844b043c27d9c0ada21cb6ed3410a927ad5fa1a6794b32c35ee468a832c"
+  },
+  "reason": "Windows default int32 rejects upstream test seed high=2**32",
+  "rng_api_restored": true,
+  "seed_draws": [
+    {
+      "dtype": "int64",
+      "high": 2147483648,
+      "low": 0,
+      "values": [
+        843828734
+      ]
+    },
+    {
+      "dtype": "int64",
+      "high": 4294967296,
+      "low": 2147483648,
+      "values": [
+        3062119789
+      ]
+    }
+  ],
+  "torch_random_nonquery_policy": "Original upstream torch.randint, no patch",
+  "vendor_source_modified": false,
+  "windows_compatibility_active": true
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_attention_s13_lr4e4_paced_v1_background/dataset_manifest.json

@@ -0,0 +1,34 @@
+{
+  "test": [
+    {
+      "inputs_sha256": "6dc295fac235e050fe7de3dc95344ac8b6057198db94d1da352f0fb910815ac5",
+      "labels_sha256": "4dd213f03b52fdde7a4f14051c1d131ae48bf6d3cfdc70f1127c9ab035ee3690",
+      "segment": 0,
+      "shape": [
+        3000,
+        64
+      ],
+      "slices": {
+        "input_seq_len": 64,
+        "num_kv_pairs": 4,
+        "num_passes": 1
+      }
+    }
+  ],
+  "train": [
+    {
+      "inputs_sha256": "e2ea685b00cd20110aa6fb97b0f8eaaa9b260b64c3c1176a017033cbf5d192a1",
+      "labels_sha256": "1bd7f13dcf6a7cbe73c21759801720c54b630e2e90d31f76fb6addecc0844691",
+      "segment": 0,
+      "shape": [
+        100000,
+        64
+      ],
+      "slices": {
+        "input_seq_len": 64,
+        "num_kv_pairs": 4,
+        "num_passes": 1
+      }
+    }
+  ]
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_attention_s13_lr4e4_paced_v1_background/effective_config.json

@@ -0,0 +1,160 @@
+{
+  "actual_data": {
+    "batch_size": 512,
+    "cache_dir": null,
+    "num_passes": 1,
+    "seed": 123,
+    "test_segments": [
+      {
+        "include_slices": true,
+        "input_seq_len": 64,
+        "name": "multiquery_ar",
+        "num_examples": 3000,
+        "num_kv_pairs": 4,
+        "power_a": 0.01,
+        "random_non_queries": false,
+        "vocab_size": 8192
+      }
+    ],
+    "train_segments": [
+      {
+        "include_slices": true,
+        "input_seq_len": 64,
+        "name": "multiquery_ar",
+        "num_examples": 100000,
+        "num_kv_pairs": 4,
+        "power_a": 0.01,
+        "random_non_queries": false,
+        "vocab_size": 8192
+      }
+    ]
+  },
+  "actual_model": {
+    "block_type": "TransformerBlock",
+    "d_model": 64,
+    "drop_path": 0.0,
+    "embed_dropout": 0.1,
+    "embedding_init_type": "default",
+    "layer_norm_epsilon": 1e-05,
+    "learnable_word_embeddings": true,
+    "max_position_embeddings": 64,
+    "multiplier": 1,
+    "n_layers": 2,
+    "name": "upstream_attention",
+    "pad_vocab_size_multiple": 1,
+    "resid_dropout": 0.0,
+    "sequence_mixer": {
+      "kwargs": {
+        "dropout": 0.1,
+        "num_heads": 1
+      },
+      "name": "zoology.mixers.attention.MHA"
+    },
+    "state_mixer": {
+      "kwargs": {},
+      "name": "torch.nn.Identity"
+    },
+    "vocab_size": 8192
+  },
+  "comparison_scope": "project SSM arms are not official Mamba/Mamba-3",
+  "data_compatibility_policy": "Official prepare_data with scoped Windows default-int64 randint bridge",
+  "epoch_checkpoint_policy": "Finite flushed validation logger callback, before earlystop/scheduler.step; recovery only, not certified exact resume",
+  "initialization_bank": {
+    "equal": null,
+    "reason": "Official attention does not share a project initialization bank"
+  },
+  "label_policy": "original token IDs, full vocabulary CE, ignore_index=-100",
+  "model_config_scope": "TrainConfig.model is metadata; actual_model is authoritative for project arms",
+  "observability_guards": "Full-logit finite hook, nonfinite-metric stop, final parameter/optimizer finite audit; no optimizer changes",
+  "profile": {
+    "lr_grid": [
+      0.0001,
+      0.00046415888336127773,
+      0.002154434690031882,
+      0.01
+    ],
+    "max_epochs": 64,
+    "operational_override": {
+      "cache_dir": null
+    },
+    "requested_factory_kwargs": {
+      "num_kv_pairs": 4,
+      "random_non_queries": false,
+      "test_power_a": 0.01,
+      "train_power_a": 0.01
+    },
+    "scope": "one_official_ICLR24_Figure2_data_training_cell",
+    "selected_cell": [
+      64,
+      4
+    ],
+    "source": "zoology/experiments/paper_configs/iclr24_zoology_figure2/configs.py"
+  },
+  "train_config": {
+    "data": {
+      "batch_size": 512,
+      "cache_dir": null,
+      "force_cache": false,
+      "num_passes": 1,
+      "seed": 123,
+      "test_configs": [
+        {
+          "input_seq_len": 64,
+          "num_examples": 3000,
+          "vocab_size": 8192
+        }
+      ],
+      "train_configs": [
+        {
+          "input_seq_len": 64,
+          "num_examples": 100000,
+          "vocab_size": 8192
+        }
+      ]
+    },
+    "early_stopping_metric": "valid/accuracy",
+    "early_stopping_threshold": 0.99,
+    "input_type": "discrete",
+    "launch_id": null,
+    "learning_rate": 0.00046415888336127773,
+    "logger": {
+      "entity": null,
+      "project_name": null
+    },
+    "loss_type": "ce",
+    "max_epochs": 64,
+    "model": {
+      "block_type": "TransformerBlock",
+      "d_model": 64,
+      "drop_path": 0.0,
+      "embed_dropout": 0.1,
+      "embedding_init_type": "default",
+      "layer_norm_epsilon": 1e-05,
+      "learnable_word_embeddings": true,
+      "max_position_embeddings": 64,
+      "multiplier": 1,
+      "n_layers": 2,
+      "name": "upstream_attention",
+      "pad_vocab_size_multiple": 1,
+      "resid_dropout": 0.0,
+      "sequence_mixer": {
+        "kwargs": {
+          "dropout": 0.1,
+          "num_heads": 1
+        },
+        "name": "zoology.mixers.attention.MHA"
+      },
+      "state_mixer": {
+        "kwargs": {},
+        "name": "torch.nn.Identity"
+      },
+      "vocab_size": 8192
+    },
+    "run_id": "upstream_attention",
+    "seed": 13,
+    "slice_keys": [],
+    "sweep_id": null,
+    "weight_decay": 0.1
+  },
+  "training_policy": "unchanged upstream Trainer.fit/compute_loss/test/compute_metrics"
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_attention_s13_lr4e4_paced_v1_background/environment_after.json

@@ -0,0 +1,61 @@
+{
+  "default_dtype": "torch.float32",
+  "device_requested": "cuda",
+  "executable": "<workspace>\\.venv-v100\\Scripts\\python.exe",
+  "gpu_name": "Tesla V100-SXM2-16GB",
+  "gpu_properties": "_CudaDeviceProperties(name='Tesla V100-SXM2-16GB', major=7, minor=0, total_memory=16242MB, multi_processor_count=80, uuid=d13b7041-55e8-4532-2fb1-f4bd3f80c13f, pci_bus_id=40, pci_device_id=0, pci_domain_id=0, L2_cache_size=6MB)",
+  "num_threads": 4,
+  "packages": {
+    "GitPython": "3.2.0",
+    "Jinja2": "3.1.6",
+    "MarkupSafe": "3.0.3",
+    "PyYAML": "6.0.3",
+    "Pygments": "2.21.0",
+    "annotated-types": "0.8.0",
+    "certifi": "2026.7.22",
+    "charset-normalizer": "3.5.2",
+    "click": "8.5.0",
+    "colorama": "0.4.6",
+    "einops": "0.8.1",
+    "filelock": "4.0.9",
+    "fsspec": "2026.9.0",
+    "gitdb": "4.0.12",
+    "idna": "3.20",
+    "iniconfig": "2.3.0",
+    "mpmath": "1.3.0",
+    "networkx": "3.7",
+    "numpy": "2.2.6",
+    "packaging": "26.3",
+    "pandas": "2.3.3",
+    "pillow": "11.3.0",
+    "pip": "25.0.1",
+    "platformdirs": "4.12.2",
+    "pluggy": "1.6.0",
+    "protobuf": "6.33.6",
+    "pydantic": "2.11.7",
+    "pydantic_core": "2.33.2",
+    "pytest": "8.4.1",
+    "python-dateutil": "2.9.0.post0",
+    "pytz": "2026.4",
+    "requests": "2.34.2",
+    "sentry-sdk": "2.71.0",
+    "setuptools": "84.0.0",
+    "six": "1.17.0",
+    "smmap": "5.0.3",
+    "sympy": "1.14.0",
+    "torch": "2.9.1+cu126",
+    "torchvision": "0.24.1+cu126",
+    "tqdm": "4.67.1",
+    "typing-inspection": "0.4.4",
+    "typing_extensions": "4.16.0",
+    "tzdata": "2026.4",
+    "urllib3": "2.8.0",
+    "wandb": "0.23.0"
+  },
+  "platform": "Windows-11-10.0.26200-SP0",
+  "python": "3.13.3 (tags/v3.13.3:6280bb5, Apr  8 2025, 14:47:33) [MSC v.1943 64 bit (AMD64)]",
+  "torch": "2.9.1+cu126",
+  "torch_cuda": "12.6",
+  "wandb_disabled": "true",
+  "wandb_mode": "disabled"
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_attention_s13_lr4e4_paced_v1_background/environment_before.json

@@ -0,0 +1,61 @@
+{
+  "default_dtype": "torch.float32",
+  "device_requested": "cuda",
+  "executable": "<workspace>\\.venv-v100\\Scripts\\python.exe",
+  "gpu_name": "Tesla V100-SXM2-16GB",
+  "gpu_properties": "_CudaDeviceProperties(name='Tesla V100-SXM2-16GB', major=7, minor=0, total_memory=16242MB, multi_processor_count=80, uuid=d13b7041-55e8-4532-2fb1-f4bd3f80c13f, pci_bus_id=40, pci_device_id=0, pci_domain_id=0, L2_cache_size=6MB)",
+  "num_threads": 4,
+  "packages": {
+    "GitPython": "3.2.0",
+    "Jinja2": "3.1.6",
+    "MarkupSafe": "3.0.3",
+    "PyYAML": "6.0.3",
+    "Pygments": "2.21.0",
+    "annotated-types": "0.8.0",
+    "certifi": "2026.7.22",
+    "charset-normalizer": "3.5.2",
+    "click": "8.5.0",
+    "colorama": "0.4.6",
+    "einops": "0.8.1",
+    "filelock": "4.0.9",
+    "fsspec": "2026.9.0",
+    "gitdb": "4.0.12",
+    "idna": "3.20",
+    "iniconfig": "2.3.0",
+    "mpmath": "1.3.0",
+    "networkx": "3.7",
+    "numpy": "2.2.6",
+    "packaging": "26.3",
+    "pandas": "2.3.3",
+    "pillow": "11.3.0",
+    "pip": "25.0.1",
+    "platformdirs": "4.12.2",
+    "pluggy": "1.6.0",
+    "protobuf": "6.33.6",
+    "pydantic": "2.11.7",
+    "pydantic_core": "2.33.2",
+    "pytest": "8.4.1",
+    "python-dateutil": "2.9.0.post0",
+    "pytz": "2026.4",
+    "requests": "2.34.2",
+    "sentry-sdk": "2.71.0",
+    "setuptools": "84.0.0",
+    "six": "1.17.0",
+    "smmap": "5.0.3",
+    "sympy": "1.14.0",
+    "torch": "2.9.1+cu126",
+    "torchvision": "0.24.1+cu126",
+    "tqdm": "4.67.1",
+    "typing-inspection": "0.4.4",
+    "typing_extensions": "4.16.0",
+    "tzdata": "2026.4",
+    "urllib3": "2.8.0",
+    "wandb": "0.23.0"
+  },
+  "platform": "Windows-11-10.0.26200-SP0",
+  "python": "3.13.3 (tags/v3.13.3:6280bb5, Apr  8 2025, 14:47:33) [MSC v.1943 64 bit (AMD64)]",
+  "torch": "2.9.1+cu126",
+  "torch_cuda": "12.6",
+  "wandb_disabled": "true",
+  "wandb_mode": "disabled"
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_attention_s13_lr4e4_paced_v1_background/execution_provenance.json

@@ -0,0 +1,36 @@
+{
+  "imported_modules": {
+    "discretization_mixing": "<workspace>\\code\\discretization_mixing\\__init__.py",
+    "discretization_mixing.core": "<workspace>\\code\\discretization_mixing\\core.py",
+    "discretization_mixing.coupled": "<workspace>\\code\\discretization_mixing\\coupled.py",
+    "discretization_mixing.gauge": "<workspace>\\code\\discretization_mixing\\gauge.py",
+    "discretization_mixing.models": "<workspace>\\code\\discretization_mixing\\models.py",
+    "discretization_mixing.retimed_models": "<workspace>\\code\\discretization_mixing\\retimed_models.py",
+    "zoology": "<workspace>\\.cache\\upstream\\zoology\\zoology\\__init__.py",
+    "zoology.config": "<workspace>\\.cache\\upstream\\zoology\\zoology\\config.py",
+    "zoology.data": "<workspace>\\.cache\\upstream\\zoology\\zoology\\data\\__init__.py",
+    "zoology.data.multiquery_ar": "<workspace>\\.cache\\upstream\\zoology\\zoology\\data\\multiquery_ar.py",
+    "zoology.data.utils": "<workspace>\\.cache\\upstream\\zoology\\zoology\\data\\utils.py",
+    "zoology.logger": "<workspace>\\.cache\\upstream\\zoology\\zoology\\logger.py",
+    "zoology.metrics": "<workspace>\\.cache\\upstream\\zoology\\zoology\\metrics.py",
+    "zoology.mixers": "<workspace>\\.cache\\upstream\\zoology\\zoology\\mixers\\__init__.py",
+    "zoology.mixers.attention": "<workspace>\\.cache\\upstream\\zoology\\zoology\\mixers\\attention.py",
+    "zoology.model": "<workspace>\\.cache\\upstream\\zoology\\zoology\\model.py",
+    "zoology.train": "<workspace>\\.cache\\upstream\\zoology\\zoology\\train.py",
+    "zoology.utils": "<workspace>\\.cache\\upstream\\zoology\\zoology\\utils.py"
+  },
+  "source_snapshot_sha256": "3599624aea58f1a45c412494563bebf43e97284a36aa68b00edc57a7260c1048",
+  "source_stable": true,
+  "upstream_after": {
+    "clean": true,
+    "commit": "1ad20d193b6113cae1e8f3c655c300d7b4b3f4bb",
+    "path": "<workspace>\\.cache\\upstream\\zoology",
+    "status": ""
+  },
+  "upstream_before": {
+    "clean": true,
+    "commit": "1ad20d193b6113cae1e8f3c655c300d7b4b3f4bb",
+    "path": "<workspace>\\.cache\\upstream\\zoology",
+    "status": ""
+  }
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_attention_s13_lr4e4_paced_v1_background/final_summary.json

@@ -0,0 +1,11 @@
+{
+  "accuracy": 0.9900833333333333,
+  "architecture": "upstream_attention",
+  "last_upstream_validation": {
+    "epoch": 29,
+    "valid/accuracy": 0.9900833333333333,
+    "valid/loss": 0.04786462336778641
+  },
+  "scope": "one_official_ICLR24_Figure2_data_training_cell",
+  "sequences": 3000
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_attention_s13_lr4e4_paced_v1_background/finite_audit.json

@@ -0,0 +1,11 @@
+{
+  "final_state": {
+    "finite": true,
+    "nonfinite_paths": [],
+    "tensor_count": 81
+  },
+  "outputs": {
+    "forward_calls": 6066,
+    "full_logits_finite": true
+  }
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_attention_s13_lr4e4_paced_v1_background/source_manifest_after.json

@@ -0,0 +1,188 @@
+{
+  "code/discretization_mixing/__init__.py": "55f93431b8e7bff41a44bbb79c1648a5bbdef2a93c4e9ecb4679c894f29f5d69",
+  "code/discretization_mixing/core.py": "5863bf8dca6d233a209b5a36598f59154fe50e2f544b6a503ed09eee65187c71",
+  "code/discretization_mixing/coupled.py": "802c51172f9a27d69f347424e877d2cbc24c4a0290749fd2be5aa90f425a4261",
+  "code/discretization_mixing/emission_anchor.py": "da271fda1756cea05aa0d3b7ae1eed37a2d02613b1eeab361e714ae827186085",
+  "code/discretization_mixing/gauge.py": "c964aaefe68eee5fc13a0acbea0e038e2d7f65c93314c9cdec617594598eae05",
+  "code/discretization_mixing/models.py": "104a3ad97ec72c1ecedd292c60a84bded62672b625eba2a242ba8ecb66669ec0",
+  "code/discretization_mixing/poststate_replay.py": "21ac93d5ad61a5fdc4d79db0fcb33c513786b1abc2d12f6746c2e46702e107b6",
+  "code/discretization_mixing/poststate_replay_graph.py": "4bd496200c4783c4d4c736a005724053addb9da403b7d416a690ebcdd23eb664",
+  "code/discretization_mixing/preflight.py": "a15acc29f83ff6cf6a03b58a8df802dbd3ea74038f8eda2b83b98265ae586a2b",
+  "code/discretization_mixing/retimed_models.py": "dd1bbf697626c8daa9a4a6a0273b005a8c362e2ce1f310450106eb782e0104ff",
+  "code/discretization_mixing/run.py": "1920751b7bccfca56badee1a6e3718df5a6f5f41f6b87171974e29bd88ce63a3",
+  "code/discretization_mixing/tasks.py": "46ad130e70a352c8aeae975abd55198ec0afe0835ce1e833ccc9f1a6822f6dd9",
+  "code/discretization_mixing/verify.py": "1d2242e53b6793b6782275b782f2a895dae959173483a5a465027ff283e812fd",
+  "tests/test_zoology_adapter.py": "f3888c21ab63ddeb0c1a98f801ae0d72010185dba6e10dbb9c06dedbbf675ca2",
+  "tools/__init__.py": "9798da858190f4f16d85d4d4804cde32cb73df831e509f93e2028ec75831d981",
+  "tools/benchmarks/__init__.py": "871c0f71154e97f70b97d89123e297267134e6dfc98e37f4b8fe8710f3bb4fd2",
+  "tools/benchmarks/run_zoology_mqar.py": "374cc4831dd6bdf27ae37f1915e7498cab199f3bbaef647d2dfe0f7b274b3d7e",
+  "tools/benchmarks/run_zoology_mqar_paced.py": "62a6ae9528bc75dd251567b4b26d508b0bced4e43e3cab32c4394328abb8b13b",
+  "tools/research_audit/__init__.py": "03cb7cd7d94757ca20e8ed1b151a996f5b29e5b369f25afcf1504f13e23b0317",
+  "tools/research_audit/fast_tasks.py": "80d5395e841e939c64523002dd83aba14fa41000f23f306fbabc6e446ba205c2",
+  "upstream/LICENSE.md": "9d9baa9d20e3c6094f555bcc8e1d000cd91c692709a7e99379a5886304d95eea",
+  "upstream/README.md": "f2444ed90224ac1d4091cb7e0e8f435a00d342f84cc1b989689d1f81fb37b96f",
+  "upstream/setup.py": "a0e6e928972015dbd65ff13577eb982aa9f2469e8de66ee472a941859c9813ed",
+  "upstream/usage.md": "ba24fab59fd2991a06468b7475ccbe57d7424e1a45f72ce00acd88d3c73dda7b",
+  "upstream/zoology/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/analysis/__init__.py": "995f279d1d190305f2ca7a43e090ed2e63a8be1aa16f9fe78bbc727d4baa73c1",
+  "upstream/zoology/analysis/capacity/mqar_fact_capacity.py": "6cf3e1f3a9b4cdab8f1b9d6d2ae8bc2778d396c5e4e7b9416fa954314389177c",
+  "upstream/zoology/analysis/capacity/mqar_repro_plots.py": "e9897daad0f78091939d7d988708810501594f4e6e92c406134c380e9881570a",
+  "upstream/zoology/analysis/mqar_plotting_example.py": "d59e78608231af34baa5baa02b21adec54ccf0ea406a47aaec553ed630527d32",
+  "upstream/zoology/analysis/paper/based_paper/based_figure1.py": "919dbcbc6e3098cc0f13acb0ef9ae289cf8cf8b078be9706e94d9ff59f1cf7d5",
+  "upstream/zoology/analysis/paper/based_paper/based_wall_clock.py": "192e111b3e02b28818ec4d10c89bfbb6b24c3afec635afbf7f66ee81176b4bae",
+  "upstream/zoology/analysis/paper/sabri/01-25_num_kv.py": "d1b8b113aed1fdd9bd021d40d90dd33baaae1f078ed2dcff96a24ce15479aae8",
+  "upstream/zoology/analysis/paper/sabri/01-26_tradeoff.py": "16fa0f3c39fb97d66eae6f9add72b9e78d11b30364ddc1eb8da1df183898d043",
+  "upstream/zoology/analysis/paper/sabri/01-27_traeoff.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/analysis/paper/zoology_paper/mqar_d_model.py": "be3cabc179a43c2019bb05f7a5a8dc4d35cd6c98a28af1814bdd91c184851eb7",
+  "upstream/zoology/analysis/paper/zoology_paper/mqar_taylor.py": "1762900e95d79332a00baf0180443013e780392088e740020fa9e84c5862c507",
+  "upstream/zoology/analysis/paper/zoology_paper/mqar_taylor_kv.py": "71c9fbaecbaa9a3263a14bcea92a3c3d6ab176244a3f0e20f56fbd2293420a26",
+  "upstream/zoology/analysis/paper/zoology_paper/num_kv.py": "9ffe1e9cce599fab39e116f61c36f83b5b1eb8879e0f382f0fa9e6471fe821e3",
+  "upstream/zoology/analysis/paper/zoology_paper/zoology_figure2.py": "940ccc8601f85abb4f6dd2deabcddc01d267f13f1da79660a6a8ad2c4c30eb42",
+  "upstream/zoology/analysis/utils.py": "290888694a9566fcbc519cf1d5ff42e5f295a0ceae1d079a8131704678c1d142",
+  "upstream/zoology/config.py": "6528d06a6a5f5cb167a843116a9d49cd3e9e3f7badc74c4f8a3f2a8faf4b9b91",
+  "upstream/zoology/data/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/data/ar_extrapolate.py": "4ade3204a92c3df781545b8748fca920ba137234ca2279ff3ece3ea52e00aa32",
+  "upstream/zoology/data/circuits.py": "c840251d356b429562aa042b8b0cab3be84c3c657d2511cb53ed7c1e408c3b38",
+  "upstream/zoology/data/compositional_mqar.py": "74d12d33d755c1bcce8c48cda56f179dc9c04d1b1abd509d5a1a26150329808f",
+  "upstream/zoology/data/forgetting_mqar.py": "fa20f397856b463ccc6b2fde4cf9b06a5f6256f70bd53f68be28e5a5e08d57b2",
+  "upstream/zoology/data/multiquery_ar.py": "d9d22c081a20f2da447d4d23cbde18c716e4f748b9e6236cb2d5adde796b3f29",
+  "upstream/zoology/data/stacked_mqar.py": "352b382941bd2c62cb638c6830f37454192abbc8fde59103c82b44449b5a360a",
+  "upstream/zoology/data/utils.py": "532170abcb36a086b2638e95796184e0f42612c66d4cc9bc4c34d892a5307c02",
+  "upstream/zoology/experiments/011126/mqar_continuous.py": "3c0b3241a5f20cd145b70ff5eb9b862d5f4254e773669d9427dd5508fb28fd86",
+  "upstream/zoology/experiments/011126/mqar_continuous_mse_loss.py": "32b968b1b0f4dab2c3de809e5dc0690c6353a0898c0ef27f7e2f59430470e555",
+  "upstream/zoology/experiments/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/experiments/basic_examples/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/experiments/basic_examples/basic.py": "69cbd3ec13ca98d13dc7c09799aa838a1411ced6ad8926268d241597d9befc54",
+  "upstream/zoology/experiments/basic_examples/basic_sweep.py": "f2b58f87447c487b3110e7be4d020b3eaab8c0a8e36eb80095c124e67d32e184",
+  "upstream/zoology/experiments/models_repo.py": "19e1c438fdfa88a538a78ad4edc822bc98d07642bc98092cfce6993f063217b8",
+  "upstream/zoology/experiments/mqar_example_configs/composition_configs.py": "e4d7eaf07954260edb407fe6d36d762b792f886d6017962c467a20df65f3c765",
+  "upstream/zoology/experiments/mqar_example_configs/composition_configs_random_false.py": "ee6843d320f6968563eaf708616ce8d5251b4ec699bcfcd89cf27d817c7384c8",
+  "upstream/zoology/experiments/mqar_example_configs/forgetting_configs.py": "5a1fdb058c5e7d04b5e4b6983478d428489c1291135ef3e4bad241ff3ab23629",
+  "upstream/zoology/experiments/mqar_example_configs/mqar_configs_random_false.py": "9ce23acde82665a56285ee4c98d8fbd0625e9acba34bcfda63dd291ab04f8fbc",
+  "upstream/zoology/experiments/mqar_example_configs/original_mqar_configs.py": "e599659b3b8d863de5946ec3cb037be9a7be9adf7eff73b52627e7f01db400cd",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-26_extrap.py": "412842831844afc4aca351fd58119c779a5735024626cc4c28dd6920652443d0",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-27_feature_map.py": "68d8ac3758082f132d229099fe5faad5052b579bb9c964288ffdda5e3a9c6213",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-27_tradeoff.py": "ad056f0282cb2a18f4bcb5096ce0d6f3aa351f032a9bd5b496626c369d899ef6",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-28_taylor_low.py": "069acc5ddee61dc2cc7c74c0a070a85715773eb91cdfc964b722671e68a9a5af",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-31_tradeoff.py": "3a57441cbe3411ed8376f8b3e46f7705a418a536ad7b76ca05f997cbd5481a39",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-01_sliding.py": "89ada96c94930b493324246a85387fa70a23e00fe91b53c43c6356d2790f318d",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-09_harder_yet.py": "9c07edd32ab2138b9abc583644bc4571073314c984fe57b35e1fd3ed7a08a5e1",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-09_new_feature_maps.py": "3015e18433f9cdf05cd43dcdbac9a38717d646503d16b0ced2a44eed41606f40",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/mqar_taylor_kv.py": "8774364410e3c738d70d7a21b5f46ca690b25ac373657f8b11f007e8bfb7533b",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_appendix/configs.py": "1cec03888000f3927e584711b221e0ebbd645459a7b5f3d291d25b57b454eaab",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_appendix/plot.py": "4b4ef9337af8354f9ee3a9f75eb569ea701c24f533aee1da1bbc50c0c30ee61b",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/README.md": "f2d6d8b5e3af9a056d02b94f5135cb0bb95abea25a09acd2d6bb16a74ce3f880",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/configs.py": "e6be1cd225bf76ab8f1135264886467b43729c8faae6bddef5874ce505693bf9",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/plot.py": "1b92399ae7d169832b469c7c31821a3bc669a7b01d46a65a7b52dfb78094fd64",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure3/configs.py": "bd1cb82c906965242c10051f36642e64345532b73624bb48ba40507a79ed92d7",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure3/plot.py": "fdb91b44e22c1b64bdd4e71f39cfa4f9bbcda6f6c8d39cd7a3beb0c3f67e80f2",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/binary_majority.py": "44edfe91ad7fae23e96d742ed909ae292687d36d1af42c5bbbf8410dd72ccce4",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/configs.py": "aef096c54b6162083cef5cd471335cf924c7863fb3d1f60f663914e755b0d45a",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/majority.py": "53a96d378a39d150be707761d720ccd2d8a52edcbf1e61e0c0bf6039d1457024",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/parity.py": "a1c87424f25610663df67fb15d08f45eb3ebf2a258a93e5c6942acf287908435",
+  "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_dmodel.py": "0aa9edd8e10324082793d9f44cc4ad14999085f640ced949bc370ebadafeabfa",
+  "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_taylor.py": "25f1be33503c182a76d1b28e0d7d56f9fdb88007e96fa66b782732ebe0c4b133",
+  "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_taylor_kv.py": "6b2970feec38354053ebbf191a82e530d3a89b5684ad4eaea17d063dbc7d6da2",
+  "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/README.md": "77152093b5357a1df7828969cf369d1cef2ef9c1273da5ca6316ae708acad0a4",
+  "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/configs.py": "c8d8dde92dd891bb5b32944a1fe65fbd1ec71819554ac81c44fe6ea265cdabbd",
+  "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/plot.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/launch.py": "bbc8b07be7c4a6c91274eba5984c2d873bb560d076d9d4cfe89b0fcadaa44c2d",
+  "upstream/zoology/logger.py": "b893d41737163e7839d01ada750dd753e2cd54021b570cf4cc647af13b052672",
+  "upstream/zoology/metrics.py": "30f7671670f456ca6c59adb54e358f85f864d1cfd7e7af3b936b6e625ddd8dfa",
+  "upstream/zoology/mixers/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/attention.py": "01a5b54afca83732b56a351000f16ec3c3d4eca0e9b4810027d27e3e79188856",
+  "upstream/zoology/mixers/base_conv.py": "ba6ef9bbb1bdff2cdc61132069ad7fe146e5abdaead6ed0b01b15ea27c2b28e8",
+  "upstream/zoology/mixers/based.py": "896010052b1932a725a19d7c70c36a80d1eb565af1953a0356ceeccf1be91cc8",
+  "upstream/zoology/mixers/bigbird.py": "02416ad0fad781c606fc3f32241132c123603fa2e886c2a53415e936bce1afd6",
+  "upstream/zoology/mixers/convolution.py": "a5b8a1b6cdf815cfe39d98c578dc3a3d80a030bf72f61644f65bab1e948cab05",
+  "upstream/zoology/mixers/deepseek/local_attention.py": "fe7a07bb2c0861388ccfba7e643cc90259ddcdc55642a4561aa7a63ca7397c34",
+  "upstream/zoology/mixers/deepseek/rotary.py": "e7036c6fbcf7d9c0114ee9b3b26401b865a6eb1ef81c08fe2d00c4281439a182",
+  "upstream/zoology/mixers/deepseek_nsa.py": "b40112585bffc416d259930a406ca499a8b699623aa21a1746fd799cf373da22",
+  "upstream/zoology/mixers/delta_net.py": "663175c6b1204c6d0aea427f628e9768e667cd90ca1652a5d75d60db90f711f1",
+  "upstream/zoology/mixers/feature_maps/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/feature_maps/all_poly.py": "bcd98450941acf6d47e999c4234bf9dd2d74276fed20a40cb13c0e28f2094c6c",
+  "upstream/zoology/mixers/feature_maps/base.py": "eee38fa9b28875792a9c5a7b82d86e3717e0c2cec79616903b469d5868154973",
+  "upstream/zoology/mixers/feature_maps/cosformer.py": "ce3816dc611599b43e5ca35eb6abe4e4763f5381e8fcb148659cc0d9580bcc44",
+  "upstream/zoology/mixers/feature_maps/exp_dim.py": "77e711e053de7d8b6970371ac913d6af6ce17a8cb7380ec9dcc30ff6fcb21de8",
+  "upstream/zoology/mixers/feature_maps/performer.py": "97be551950faec1e30f1bffddf905807233800caf3d52b6ed2b4605724a7683d",
+  "upstream/zoology/mixers/feature_maps/taylor.py": "b4cc2ba342763850915a8ee4e38476d73cf23281bcba64e4cba5eff18ad1f33c",
+  "upstream/zoology/mixers/gated_delta_net.py": "674dd32fb483ecf2ad5855aed7b9fc2fe95cd83a1937501395c828d3f3efba54",
+  "upstream/zoology/mixers/gla.py": "e29ab52a1e24264ffbd27f086ffadb24d9257e8fa66c962af6efb0ed81c4e98e",
+  "upstream/zoology/mixers/h3/__init__.py": "61baeefe5d34e8892656ebad1ccd1115894abe9dcd99b46537c609f98f969fef",
+  "upstream/zoology/mixers/h3/dplr.py": "76e764b87ae211b2e4aa1937d4187343606f34893eea77794bf58a7594feac8d",
+  "upstream/zoology/mixers/h3/h3.py": "2970534f9879e7000793f02e0a4f27cc22bd7c5b5c5610ad1b570945d007e845",
+  "upstream/zoology/mixers/h3/hippo.py": "781b41f259d91216bedf701e4747443e6aec5814af21047016013d9fd92764c8",
+  "upstream/zoology/mixers/h3/ops/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/h3/ops/fftconv.py": "b013ac4045864fbee1de82a89acccffa5438acb4fa12c1817c1a3ca1d1b3734d",
+  "upstream/zoology/mixers/h3/ops/krylov.py": "34f8b89ab034c699649cf6906a3fe52ea5d70551c87059d852d9af54e52cadbe",
+  "upstream/zoology/mixers/h3/ops/toeplitz.py": "41cbc75962d7c1d28da88856cb155b460c9471719fa632179447d482d1487124",
+  "upstream/zoology/mixers/h3/ops/vandermonde.py": "9534bfe44fb9628d1973a9253ba3ceb8858e21e366c9ee4512d705cbd1bf2163",
+  "upstream/zoology/mixers/h3/ss_kernel.py": "8d1d0db656a174b5403c0b0870c893c9ae5a2041087e47381759c1eb5b3b4b05",
+  "upstream/zoology/mixers/h3/ss_kernel_diag.py": "bc69455b99f7daeb25f382cf04e439706a9b5fba6811d610b3008d6488da6790",
+  "upstream/zoology/mixers/h3/ss_kernel_shift.py": "ccc622624c4656020d43036d7649acfbbf031b063daf132f52c28adab1e7062b",
+  "upstream/zoology/mixers/h3/ssm_utils.py": "4e2ad344fcfe1d5c6ac86a66c92f4c3935ecbb6562c7206f811095eca7eda1d8",
+  "upstream/zoology/mixers/hybrid.py": "e855a03ebaee79ad50ad342026651d4821a60cc69c674f06ebef40b98335537f",
+  "upstream/zoology/mixers/hyena.py": "e22d45babe794e873a183232ed35a0fa524f8d3af082ab4d466c78eb55c60429",
+  "upstream/zoology/mixers/listing.py": "12f227123e45ebf98215189a2e8c9f022a153317f5aa0a426c662e3bd51e8d1a",
+  "upstream/zoology/mixers/mamba.py": "0d0c250e0edac1a3f5f4a415f6e36cbc4cbe5dff416666d32e4d0c99ab727f31",
+  "upstream/zoology/mixers/mamba2.py": "9fa91391bdf70b82635d9bbee3d9455d04fdd5b741f5d10f12a6ad1eed9f813d",
+  "upstream/zoology/mixers/mamba_ssm/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/ops/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/ops/selective_scan_interface.py": "061e90aa71e2f4d783cc759d15f5896344548cc8ba66ad3050859df407026d7c",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/k_activations.py": "ffbb19486ce6f24ac7082f78915ce7cae40e1f507d39621ac964dd3c01468c26",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/layer_norm.py": "19b92346f5aa54c489fb19e6054552a0f6bb6fb8e4b3692417f0d9d83ec07144",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/layernorm.py": "a695126596345d3abadea9928550caf3eff74c13cda110cc0ca0a9596e93da97",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/layernorm_gated.py": "3a37ef83da00ec889598519e94e02438e38f7ddd29fb10ddcc423948f5fd7c35",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/selective_state_update.py": "2cad6e8464f06d504fecb2b5ac55edefc1fbdad1e2c10b345ae933d6ea8f9ca5",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/softplus.py": "1913728b87c1678922594319a8000287df4318c5420d4982dad7e427ca76bac7",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_bmm.py": "677e503a7d8950f848c0e51cf0f587bed3eb3e0a401adfb8b3eb33cd406b3c41",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_chunk_scan.py": "d67bdd87c5373bc33bf8cd255071fc10c8ed9b88ac51830a40aee11599b67a81",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_chunk_state.py": "7def68d10a9f50c7428349941effa742f8140daf99df83dc40e0db8db4efe3b9",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_combined.py": "a6f5383ac64b5db5d3f2ba68c6f3a68a7b0e4c6ea99d7b8e35ace7034dbd0e0f",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_state_passing.py": "a9ff7fca5b3d70433441a2526c5c9d88a8d26f915d16d9eb2e327aba39ae9522",
+  "upstream/zoology/mixers/mamba_ssm/selective_scan_interface.py": "eb1d25ef01bc909834a192beba616fbffc5d91bdcb4f267b52fb44035e358021",
+  "upstream/zoology/mixers/mamba_ssm/triton/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/triton/layernorm.py": "502788d223db325397969ad61166b3c56a09729acf1fd8b48b249ebc4582ed8f",
+  "upstream/zoology/mixers/mamba_ssm/triton/selective_state_update.py": "7053c88e64be5f8e2f26a776bf25ca2d85f5d506b6f112af48d87ab15a0f93a5",
+  "upstream/zoology/mixers/mlp.py": "eb03f4d04b84b8eb692bd98647e15abf1f168ae9b7953facb48693c1848b0fa6",
+  "upstream/zoology/mixers/mra/__init__.py": "f1b32ae4d6398e2f0bf125d8541a12edfbd0786632eb82865a9c04a44dde9c3b",
+  "upstream/zoology/mixers/mra/attention.py": "6ded4eeacbf1b24aea8dfcefe9d98e2af0c2b909b25cf238f3f5d7f589d43f99",
+  "upstream/zoology/mixers/mra/autograd_function.py": "b30a4d4084626e5d85fbebd00abf9c5ceb51e5f266c2b7cb5d2bfcf418a37164",
+  "upstream/zoology/mixers/mra/cuda/cuda_kernel.cu": "fad8eee8738ff59ebc00606c0cff6a100b3898288852e967f0b3e8f58672e167",
+  "upstream/zoology/mixers/mra/cuda/cuda_kernel.h": "58607c30a33c4980862edb5169c312f2327cbdbc3fd79f56f198c99525705465",
+  "upstream/zoology/mixers/mra/cuda/cuda_launch.cu": "9051d010bd80cd91a056349105b7c922468fcff06e713288b45741c5ec06e18e",
+  "upstream/zoology/mixers/mra/cuda/cuda_launch.h": "e006d7e5b11a1ff8e9ffbef67db4d5902896f2317f94662589d7bec6f488ce6b",
+  "upstream/zoology/mixers/mra/cuda/torch_extension.cpp": "6e64cac2cb7108264f15d9d961e3798b51d560c4c19a10d52c29ecfe466be331",
+  "upstream/zoology/mixers/mra/kernel.py": "27a5e962b027ae808e76f0ca1b95cf3a685d9a7b5ce3dfc9ea6b50cf0e621546",
+  "upstream/zoology/mixers/mra/mra.py": "9b9ea0deaa9c5f4be79db2c1d1f4e834a658005d02d8dd619d39a51cef4204f8",
+  "upstream/zoology/mixers/nysfromformer.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/nystromformer/__init__.py": "478954c54180640e228b722f89d7596fe174ee084737e6d6024942f1dd272ade",
+  "upstream/zoology/mixers/nystromformer/attn.py": "d55b1f8c3da6373d65f332efb0982752a0941dae01f9a368d0138cc41cc6aa91",
+  "upstream/zoology/mixers/nystromformer/attn_mask.py": "8c742f0943663b1e372ceab69fd6f0d22c046632cd501d1148015a5acdd3f73a",
+  "upstream/zoology/mixers/nystromformer/core.py": "a2767ad965e59a00dfef84c86754488d7f9f03fa38591e66f2b76668323428cb",
+  "upstream/zoology/mixers/nystromformer/nystromformer.py": "9fba6069a1aa7152ab6a8e76199ec9ccd28c6eb2f8a9fb4591d8e4428b9952b0",
+  "upstream/zoology/mixers/nystromformer/ops.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/nystromformer/utils.py": "7bd8fe104fa3c29ef6593e5095395f4a1f09c6fa080bc6daccb71ad6c07b8946",
+  "upstream/zoology/mixers/rwkv.py": "ed4e3b48aa94618006500a3e197127eaac2e8d4f0dae5ce36797c8984f75f266",
+  "upstream/zoology/mixers/rwkv/v4/wkv_cuda.cu": "1e74c2b9bc9917bf7ce55aa05b38ce5038485e7b7c787d21eb98103836a32ab4",
+  "upstream/zoology/mixers/rwkv/v4/wkv_op.cpp": "f9bcfbc615fa7d9e6623a9b91f0b802715b3814eb1c50595f41234d775f6cc10",
+  "upstream/zoology/mixers/rwkv/v5/wkv5_cuda.cu": "9b76f9bf7958cef301ff49d445ceca031a21e485fbec4453e801fbcbde6b6e45",
+  "upstream/zoology/mixers/rwkv/v5/wkv5_op.cpp": "2fc8efa6c6a50abee0849dbe6c7596483466de9d9098d42312983b2af45c8f6f",
+  "upstream/zoology/mixers/rwkv5.py": "bdbe6dd5de9274097c1c9eb52fce49ba7a75bdbac15210e21c45b67af0544116",
+  "upstream/zoology/mixers/rwkv7.py": "51fc5b7f7632a840bbd1866eb03146647b784e6e0696d8e019f0075b195d211a",
+  "upstream/zoology/mixers/scatterbrain/__init__.py": "e9ea7d53368d1e7994249c2c0fa5ca7dfa2961995dbbe11724870e0989afae19",
+  "upstream/zoology/mixers/scatterbrain/attn.py": "1676f9e02abaeda31eb65b594c4b37d20c194f08c4dc719a44937d6ea70daa63",
+  "upstream/zoology/mixers/scatterbrain/feature_maps_sb.py": "435341a1fae3ec18d28d1c59ef76fd7ddaa31e7790a731f69a2ed0614f7cdc54",
+  "upstream/zoology/mixers/scatterbrain/masking.py": "13f16706ce8cb21e3e457e9c561cca0695757b05ef83ad28a332d115dbceb37a",
+  "upstream/zoology/mixers/scatterbrain/projection_utils.py": "58361c02501e0f3947c3d978c9789f63caa65edc6c5abd35f60f0b5d95d647ba",
+  "upstream/zoology/mixers/scatterbrain/scatterbrain_utils.py": "6f836e9832ca563039bb752c50c7bc4b84bd7a03125573cc54d1340eef5ef0d5",
+  "upstream/zoology/mixers/scatterbrain_new.py": "67a3521b4607c6320b37d81d3826abd293444a6c72c8715f7a18f9fad872973c",
+  "upstream/zoology/mixers/selective.py": "cd2d58ae0ad53c2278f9437e3be871e215eb5a72d125ebf45e3ca2a5b1c99a3b",
+  "upstream/zoology/mixers/slide_attn.py": "d7af8113f3cd579c1337f306f47b7c79c820c66aff509c82572fbfbc1f3b33fb",
+  "upstream/zoology/mixers/ttt.py": "c75ff49adccee87198b0b8815fc3e264684c03c10bc46b87bb1d3ec6d1daba2a",
+  "upstream/zoology/model.py": "ec29777ff3f4ba7ac91b440a860c8769a6e9b8471a08a84d3e19a36488170fcb",
+  "upstream/zoology/train.py": "18128f75f468539ea725a4391028ea313c20b2f644530610354db930f74e4658",
+  "upstream/zoology/utils.py": "0bca95c777dfe73806895dac12efe5d0c4fda1edba19810a29866f5565891f57"
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_attention_s13_lr4e4_paced_v1_background/source_manifest_before.json

@@ -0,0 +1,188 @@
+{
+  "code/discretization_mixing/__init__.py": "55f93431b8e7bff41a44bbb79c1648a5bbdef2a93c4e9ecb4679c894f29f5d69",
+  "code/discretization_mixing/core.py": "5863bf8dca6d233a209b5a36598f59154fe50e2f544b6a503ed09eee65187c71",
+  "code/discretization_mixing/coupled.py": "802c51172f9a27d69f347424e877d2cbc24c4a0290749fd2be5aa90f425a4261",
+  "code/discretization_mixing/emission_anchor.py": "da271fda1756cea05aa0d3b7ae1eed37a2d02613b1eeab361e714ae827186085",
+  "code/discretization_mixing/gauge.py": "c964aaefe68eee5fc13a0acbea0e038e2d7f65c93314c9cdec617594598eae05",
+  "code/discretization_mixing/models.py": "104a3ad97ec72c1ecedd292c60a84bded62672b625eba2a242ba8ecb66669ec0",
+  "code/discretization_mixing/poststate_replay.py": "21ac93d5ad61a5fdc4d79db0fcb33c513786b1abc2d12f6746c2e46702e107b6",
+  "code/discretization_mixing/poststate_replay_graph.py": "4bd496200c4783c4d4c736a005724053addb9da403b7d416a690ebcdd23eb664",
+  "code/discretization_mixing/preflight.py": "a15acc29f83ff6cf6a03b58a8df802dbd3ea74038f8eda2b83b98265ae586a2b",
+  "code/discretization_mixing/retimed_models.py": "dd1bbf697626c8daa9a4a6a0273b005a8c362e2ce1f310450106eb782e0104ff",
+  "code/discretization_mixing/run.py": "1920751b7bccfca56badee1a6e3718df5a6f5f41f6b87171974e29bd88ce63a3",
+  "code/discretization_mixing/tasks.py": "46ad130e70a352c8aeae975abd55198ec0afe0835ce1e833ccc9f1a6822f6dd9",
+  "code/discretization_mixing/verify.py": "1d2242e53b6793b6782275b782f2a895dae959173483a5a465027ff283e812fd",
+  "tests/test_zoology_adapter.py": "f3888c21ab63ddeb0c1a98f801ae0d72010185dba6e10dbb9c06dedbbf675ca2",
+  "tools/__init__.py": "9798da858190f4f16d85d4d4804cde32cb73df831e509f93e2028ec75831d981",
+  "tools/benchmarks/__init__.py": "871c0f71154e97f70b97d89123e297267134e6dfc98e37f4b8fe8710f3bb4fd2",
+  "tools/benchmarks/run_zoology_mqar.py": "374cc4831dd6bdf27ae37f1915e7498cab199f3bbaef647d2dfe0f7b274b3d7e",
+  "tools/benchmarks/run_zoology_mqar_paced.py": "62a6ae9528bc75dd251567b4b26d508b0bced4e43e3cab32c4394328abb8b13b",
+  "tools/research_audit/__init__.py": "03cb7cd7d94757ca20e8ed1b151a996f5b29e5b369f25afcf1504f13e23b0317",
+  "tools/research_audit/fast_tasks.py": "80d5395e841e939c64523002dd83aba14fa41000f23f306fbabc6e446ba205c2",
+  "upstream/LICENSE.md": "9d9baa9d20e3c6094f555bcc8e1d000cd91c692709a7e99379a5886304d95eea",
+  "upstream/README.md": "f2444ed90224ac1d4091cb7e0e8f435a00d342f84cc1b989689d1f81fb37b96f",
+  "upstream/setup.py": "a0e6e928972015dbd65ff13577eb982aa9f2469e8de66ee472a941859c9813ed",
+  "upstream/usage.md": "ba24fab59fd2991a06468b7475ccbe57d7424e1a45f72ce00acd88d3c73dda7b",
+  "upstream/zoology/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/analysis/__init__.py": "995f279d1d190305f2ca7a43e090ed2e63a8be1aa16f9fe78bbc727d4baa73c1",
+  "upstream/zoology/analysis/capacity/mqar_fact_capacity.py": "6cf3e1f3a9b4cdab8f1b9d6d2ae8bc2778d396c5e4e7b9416fa954314389177c",
+  "upstream/zoology/analysis/capacity/mqar_repro_plots.py": "e9897daad0f78091939d7d988708810501594f4e6e92c406134c380e9881570a",
+  "upstream/zoology/analysis/mqar_plotting_example.py": "d59e78608231af34baa5baa02b21adec54ccf0ea406a47aaec553ed630527d32",
+  "upstream/zoology/analysis/paper/based_paper/based_figure1.py": "919dbcbc6e3098cc0f13acb0ef9ae289cf8cf8b078be9706e94d9ff59f1cf7d5",
+  "upstream/zoology/analysis/paper/based_paper/based_wall_clock.py": "192e111b3e02b28818ec4d10c89bfbb6b24c3afec635afbf7f66ee81176b4bae",
+  "upstream/zoology/analysis/paper/sabri/01-25_num_kv.py": "d1b8b113aed1fdd9bd021d40d90dd33baaae1f078ed2dcff96a24ce15479aae8",
+  "upstream/zoology/analysis/paper/sabri/01-26_tradeoff.py": "16fa0f3c39fb97d66eae6f9add72b9e78d11b30364ddc1eb8da1df183898d043",
+  "upstream/zoology/analysis/paper/sabri/01-27_traeoff.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/analysis/paper/zoology_paper/mqar_d_model.py": "be3cabc179a43c2019bb05f7a5a8dc4d35cd6c98a28af1814bdd91c184851eb7",
+  "upstream/zoology/analysis/paper/zoology_paper/mqar_taylor.py": "1762900e95d79332a00baf0180443013e780392088e740020fa9e84c5862c507",
+  "upstream/zoology/analysis/paper/zoology_paper/mqar_taylor_kv.py": "71c9fbaecbaa9a3263a14bcea92a3c3d6ab176244a3f0e20f56fbd2293420a26",
+  "upstream/zoology/analysis/paper/zoology_paper/num_kv.py": "9ffe1e9cce599fab39e116f61c36f83b5b1eb8879e0f382f0fa9e6471fe821e3",
+  "upstream/zoology/analysis/paper/zoology_paper/zoology_figure2.py": "940ccc8601f85abb4f6dd2deabcddc01d267f13f1da79660a6a8ad2c4c30eb42",
+  "upstream/zoology/analysis/utils.py": "290888694a9566fcbc519cf1d5ff42e5f295a0ceae1d079a8131704678c1d142",
+  "upstream/zoology/config.py": "6528d06a6a5f5cb167a843116a9d49cd3e9e3f7badc74c4f8a3f2a8faf4b9b91",
+  "upstream/zoology/data/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/data/ar_extrapolate.py": "4ade3204a92c3df781545b8748fca920ba137234ca2279ff3ece3ea52e00aa32",
+  "upstream/zoology/data/circuits.py": "c840251d356b429562aa042b8b0cab3be84c3c657d2511cb53ed7c1e408c3b38",
+  "upstream/zoology/data/compositional_mqar.py": "74d12d33d755c1bcce8c48cda56f179dc9c04d1b1abd509d5a1a26150329808f",
+  "upstream/zoology/data/forgetting_mqar.py": "fa20f397856b463ccc6b2fde4cf9b06a5f6256f70bd53f68be28e5a5e08d57b2",
+  "upstream/zoology/data/multiquery_ar.py": "d9d22c081a20f2da447d4d23cbde18c716e4f748b9e6236cb2d5adde796b3f29",
+  "upstream/zoology/data/stacked_mqar.py": "352b382941bd2c62cb638c6830f37454192abbc8fde59103c82b44449b5a360a",
+  "upstream/zoology/data/utils.py": "532170abcb36a086b2638e95796184e0f42612c66d4cc9bc4c34d892a5307c02",
+  "upstream/zoology/experiments/011126/mqar_continuous.py": "3c0b3241a5f20cd145b70ff5eb9b862d5f4254e773669d9427dd5508fb28fd86",
+  "upstream/zoology/experiments/011126/mqar_continuous_mse_loss.py": "32b968b1b0f4dab2c3de809e5dc0690c6353a0898c0ef27f7e2f59430470e555",
+  "upstream/zoology/experiments/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/experiments/basic_examples/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/experiments/basic_examples/basic.py": "69cbd3ec13ca98d13dc7c09799aa838a1411ced6ad8926268d241597d9befc54",
+  "upstream/zoology/experiments/basic_examples/basic_sweep.py": "f2b58f87447c487b3110e7be4d020b3eaab8c0a8e36eb80095c124e67d32e184",
+  "upstream/zoology/experiments/models_repo.py": "19e1c438fdfa88a538a78ad4edc822bc98d07642bc98092cfce6993f063217b8",
+  "upstream/zoology/experiments/mqar_example_configs/composition_configs.py": "e4d7eaf07954260edb407fe6d36d762b792f886d6017962c467a20df65f3c765",
+  "upstream/zoology/experiments/mqar_example_configs/composition_configs_random_false.py": "ee6843d320f6968563eaf708616ce8d5251b4ec699bcfcd89cf27d817c7384c8",
+  "upstream/zoology/experiments/mqar_example_configs/forgetting_configs.py": "5a1fdb058c5e7d04b5e4b6983478d428489c1291135ef3e4bad241ff3ab23629",
+  "upstream/zoology/experiments/mqar_example_configs/mqar_configs_random_false.py": "9ce23acde82665a56285ee4c98d8fbd0625e9acba34bcfda63dd291ab04f8fbc",
+  "upstream/zoology/experiments/mqar_example_configs/original_mqar_configs.py": "e599659b3b8d863de5946ec3cb037be9a7be9adf7eff73b52627e7f01db400cd",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-26_extrap.py": "412842831844afc4aca351fd58119c779a5735024626cc4c28dd6920652443d0",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-27_feature_map.py": "68d8ac3758082f132d229099fe5faad5052b579bb9c964288ffdda5e3a9c6213",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-27_tradeoff.py": "ad056f0282cb2a18f4bcb5096ce0d6f3aa351f032a9bd5b496626c369d899ef6",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-28_taylor_low.py": "069acc5ddee61dc2cc7c74c0a070a85715773eb91cdfc964b722671e68a9a5af",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-31_tradeoff.py": "3a57441cbe3411ed8376f8b3e46f7705a418a536ad7b76ca05f997cbd5481a39",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-01_sliding.py": "89ada96c94930b493324246a85387fa70a23e00fe91b53c43c6356d2790f318d",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-09_harder_yet.py": "9c07edd32ab2138b9abc583644bc4571073314c984fe57b35e1fd3ed7a08a5e1",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-09_new_feature_maps.py": "3015e18433f9cdf05cd43dcdbac9a38717d646503d16b0ced2a44eed41606f40",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/mqar_taylor_kv.py": "8774364410e3c738d70d7a21b5f46ca690b25ac373657f8b11f007e8bfb7533b",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_appendix/configs.py": "1cec03888000f3927e584711b221e0ebbd645459a7b5f3d291d25b57b454eaab",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_appendix/plot.py": "4b4ef9337af8354f9ee3a9f75eb569ea701c24f533aee1da1bbc50c0c30ee61b",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/README.md": "f2d6d8b5e3af9a056d02b94f5135cb0bb95abea25a09acd2d6bb16a74ce3f880",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/configs.py": "e6be1cd225bf76ab8f1135264886467b43729c8faae6bddef5874ce505693bf9",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/plot.py": "1b92399ae7d169832b469c7c31821a3bc669a7b01d46a65a7b52dfb78094fd64",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure3/configs.py": "bd1cb82c906965242c10051f36642e64345532b73624bb48ba40507a79ed92d7",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure3/plot.py": "fdb91b44e22c1b64bdd4e71f39cfa4f9bbcda6f6c8d39cd7a3beb0c3f67e80f2",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/binary_majority.py": "44edfe91ad7fae23e96d742ed909ae292687d36d1af42c5bbbf8410dd72ccce4",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/configs.py": "aef096c54b6162083cef5cd471335cf924c7863fb3d1f60f663914e755b0d45a",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/majority.py": "53a96d378a39d150be707761d720ccd2d8a52edcbf1e61e0c0bf6039d1457024",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/parity.py": "a1c87424f25610663df67fb15d08f45eb3ebf2a258a93e5c6942acf287908435",
+  "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_dmodel.py": "0aa9edd8e10324082793d9f44cc4ad14999085f640ced949bc370ebadafeabfa",
+  "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_taylor.py": "25f1be33503c182a76d1b28e0d7d56f9fdb88007e96fa66b782732ebe0c4b133",
+  "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_taylor_kv.py": "6b2970feec38354053ebbf191a82e530d3a89b5684ad4eaea17d063dbc7d6da2",
+  "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/README.md": "77152093b5357a1df7828969cf369d1cef2ef9c1273da5ca6316ae708acad0a4",
+  "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/configs.py": "c8d8dde92dd891bb5b32944a1fe65fbd1ec71819554ac81c44fe6ea265cdabbd",
+  "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/plot.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/launch.py": "bbc8b07be7c4a6c91274eba5984c2d873bb560d076d9d4cfe89b0fcadaa44c2d",
+  "upstream/zoology/logger.py": "b893d41737163e7839d01ada750dd753e2cd54021b570cf4cc647af13b052672",
+  "upstream/zoology/metrics.py": "30f7671670f456ca6c59adb54e358f85f864d1cfd7e7af3b936b6e625ddd8dfa",
+  "upstream/zoology/mixers/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/attention.py": "01a5b54afca83732b56a351000f16ec3c3d4eca0e9b4810027d27e3e79188856",
+  "upstream/zoology/mixers/base_conv.py": "ba6ef9bbb1bdff2cdc61132069ad7fe146e5abdaead6ed0b01b15ea27c2b28e8",
+  "upstream/zoology/mixers/based.py": "896010052b1932a725a19d7c70c36a80d1eb565af1953a0356ceeccf1be91cc8",
+  "upstream/zoology/mixers/bigbird.py": "02416ad0fad781c606fc3f32241132c123603fa2e886c2a53415e936bce1afd6",
+  "upstream/zoology/mixers/convolution.py": "a5b8a1b6cdf815cfe39d98c578dc3a3d80a030bf72f61644f65bab1e948cab05",
+  "upstream/zoology/mixers/deepseek/local_attention.py": "fe7a07bb2c0861388ccfba7e643cc90259ddcdc55642a4561aa7a63ca7397c34",
+  "upstream/zoology/mixers/deepseek/rotary.py": "e7036c6fbcf7d9c0114ee9b3b26401b865a6eb1ef81c08fe2d00c4281439a182",
+  "upstream/zoology/mixers/deepseek_nsa.py": "b40112585bffc416d259930a406ca499a8b699623aa21a1746fd799cf373da22",
+  "upstream/zoology/mixers/delta_net.py": "663175c6b1204c6d0aea427f628e9768e667cd90ca1652a5d75d60db90f711f1",
+  "upstream/zoology/mixers/feature_maps/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/feature_maps/all_poly.py": "bcd98450941acf6d47e999c4234bf9dd2d74276fed20a40cb13c0e28f2094c6c",
+  "upstream/zoology/mixers/feature_maps/base.py": "eee38fa9b28875792a9c5a7b82d86e3717e0c2cec79616903b469d5868154973",
+  "upstream/zoology/mixers/feature_maps/cosformer.py": "ce3816dc611599b43e5ca35eb6abe4e4763f5381e8fcb148659cc0d9580bcc44",
+  "upstream/zoology/mixers/feature_maps/exp_dim.py": "77e711e053de7d8b6970371ac913d6af6ce17a8cb7380ec9dcc30ff6fcb21de8",
+  "upstream/zoology/mixers/feature_maps/performer.py": "97be551950faec1e30f1bffddf905807233800caf3d52b6ed2b4605724a7683d",
+  "upstream/zoology/mixers/feature_maps/taylor.py": "b4cc2ba342763850915a8ee4e38476d73cf23281bcba64e4cba5eff18ad1f33c",
+  "upstream/zoology/mixers/gated_delta_net.py": "674dd32fb483ecf2ad5855aed7b9fc2fe95cd83a1937501395c828d3f3efba54",
+  "upstream/zoology/mixers/gla.py": "e29ab52a1e24264ffbd27f086ffadb24d9257e8fa66c962af6efb0ed81c4e98e",
+  "upstream/zoology/mixers/h3/__init__.py": "61baeefe5d34e8892656ebad1ccd1115894abe9dcd99b46537c609f98f969fef",
+  "upstream/zoology/mixers/h3/dplr.py": "76e764b87ae211b2e4aa1937d4187343606f34893eea77794bf58a7594feac8d",
+  "upstream/zoology/mixers/h3/h3.py": "2970534f9879e7000793f02e0a4f27cc22bd7c5b5c5610ad1b570945d007e845",
+  "upstream/zoology/mixers/h3/hippo.py": "781b41f259d91216bedf701e4747443e6aec5814af21047016013d9fd92764c8",
+  "upstream/zoology/mixers/h3/ops/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/h3/ops/fftconv.py": "b013ac4045864fbee1de82a89acccffa5438acb4fa12c1817c1a3ca1d1b3734d",
+  "upstream/zoology/mixers/h3/ops/krylov.py": "34f8b89ab034c699649cf6906a3fe52ea5d70551c87059d852d9af54e52cadbe",
+  "upstream/zoology/mixers/h3/ops/toeplitz.py": "41cbc75962d7c1d28da88856cb155b460c9471719fa632179447d482d1487124",
+  "upstream/zoology/mixers/h3/ops/vandermonde.py": "9534bfe44fb9628d1973a9253ba3ceb8858e21e366c9ee4512d705cbd1bf2163",
+  "upstream/zoology/mixers/h3/ss_kernel.py": "8d1d0db656a174b5403c0b0870c893c9ae5a2041087e47381759c1eb5b3b4b05",
+  "upstream/zoology/mixers/h3/ss_kernel_diag.py": "bc69455b99f7daeb25f382cf04e439706a9b5fba6811d610b3008d6488da6790",
+  "upstream/zoology/mixers/h3/ss_kernel_shift.py": "ccc622624c4656020d43036d7649acfbbf031b063daf132f52c28adab1e7062b",
+  "upstream/zoology/mixers/h3/ssm_utils.py": "4e2ad344fcfe1d5c6ac86a66c92f4c3935ecbb6562c7206f811095eca7eda1d8",
+  "upstream/zoology/mixers/hybrid.py": "e855a03ebaee79ad50ad342026651d4821a60cc69c674f06ebef40b98335537f",
+  "upstream/zoology/mixers/hyena.py": "e22d45babe794e873a183232ed35a0fa524f8d3af082ab4d466c78eb55c60429",
+  "upstream/zoology/mixers/listing.py": "12f227123e45ebf98215189a2e8c9f022a153317f5aa0a426c662e3bd51e8d1a",
+  "upstream/zoology/mixers/mamba.py": "0d0c250e0edac1a3f5f4a415f6e36cbc4cbe5dff416666d32e4d0c99ab727f31",
+  "upstream/zoology/mixers/mamba2.py": "9fa91391bdf70b82635d9bbee3d9455d04fdd5b741f5d10f12a6ad1eed9f813d",
+  "upstream/zoology/mixers/mamba_ssm/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/ops/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/ops/selective_scan_interface.py": "061e90aa71e2f4d783cc759d15f5896344548cc8ba66ad3050859df407026d7c",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/k_activations.py": "ffbb19486ce6f24ac7082f78915ce7cae40e1f507d39621ac964dd3c01468c26",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/layer_norm.py": "19b92346f5aa54c489fb19e6054552a0f6bb6fb8e4b3692417f0d9d83ec07144",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/layernorm.py": "a695126596345d3abadea9928550caf3eff74c13cda110cc0ca0a9596e93da97",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/layernorm_gated.py": "3a37ef83da00ec889598519e94e02438e38f7ddd29fb10ddcc423948f5fd7c35",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/selective_state_update.py": "2cad6e8464f06d504fecb2b5ac55edefc1fbdad1e2c10b345ae933d6ea8f9ca5",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/softplus.py": "1913728b87c1678922594319a8000287df4318c5420d4982dad7e427ca76bac7",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_bmm.py": "677e503a7d8950f848c0e51cf0f587bed3eb3e0a401adfb8b3eb33cd406b3c41",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_chunk_scan.py": "d67bdd87c5373bc33bf8cd255071fc10c8ed9b88ac51830a40aee11599b67a81",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_chunk_state.py": "7def68d10a9f50c7428349941effa742f8140daf99df83dc40e0db8db4efe3b9",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_combined.py": "a6f5383ac64b5db5d3f2ba68c6f3a68a7b0e4c6ea99d7b8e35ace7034dbd0e0f",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_state_passing.py": "a9ff7fca5b3d70433441a2526c5c9d88a8d26f915d16d9eb2e327aba39ae9522",
+  "upstream/zoology/mixers/mamba_ssm/selective_scan_interface.py": "eb1d25ef01bc909834a192beba616fbffc5d91bdcb4f267b52fb44035e358021",
+  "upstream/zoology/mixers/mamba_ssm/triton/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/triton/layernorm.py": "502788d223db325397969ad61166b3c56a09729acf1fd8b48b249ebc4582ed8f",
+  "upstream/zoology/mixers/mamba_ssm/triton/selective_state_update.py": "7053c88e64be5f8e2f26a776bf25ca2d85f5d506b6f112af48d87ab15a0f93a5",
+  "upstream/zoology/mixers/mlp.py": "eb03f4d04b84b8eb692bd98647e15abf1f168ae9b7953facb48693c1848b0fa6",
+  "upstream/zoology/mixers/mra/__init__.py": "f1b32ae4d6398e2f0bf125d8541a12edfbd0786632eb82865a9c04a44dde9c3b",
+  "upstream/zoology/mixers/mra/attention.py": "6ded4eeacbf1b24aea8dfcefe9d98e2af0c2b909b25cf238f3f5d7f589d43f99",
+  "upstream/zoology/mixers/mra/autograd_function.py": "b30a4d4084626e5d85fbebd00abf9c5ceb51e5f266c2b7cb5d2bfcf418a37164",
+  "upstream/zoology/mixers/mra/cuda/cuda_kernel.cu": "fad8eee8738ff59ebc00606c0cff6a100b3898288852e967f0b3e8f58672e167",
+  "upstream/zoology/mixers/mra/cuda/cuda_kernel.h": "58607c30a33c4980862edb5169c312f2327cbdbc3fd79f56f198c99525705465",
+  "upstream/zoology/mixers/mra/cuda/cuda_launch.cu": "9051d010bd80cd91a056349105b7c922468fcff06e713288b45741c5ec06e18e",
+  "upstream/zoology/mixers/mra/cuda/cuda_launch.h": "e006d7e5b11a1ff8e9ffbef67db4d5902896f2317f94662589d7bec6f488ce6b",
+  "upstream/zoology/mixers/mra/cuda/torch_extension.cpp": "6e64cac2cb7108264f15d9d961e3798b51d560c4c19a10d52c29ecfe466be331",
+  "upstream/zoology/mixers/mra/kernel.py": "27a5e962b027ae808e76f0ca1b95cf3a685d9a7b5ce3dfc9ea6b50cf0e621546",
+  "upstream/zoology/mixers/mra/mra.py": "9b9ea0deaa9c5f4be79db2c1d1f4e834a658005d02d8dd619d39a51cef4204f8",
+  "upstream/zoology/mixers/nysfromformer.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/nystromformer/__init__.py": "478954c54180640e228b722f89d7596fe174ee084737e6d6024942f1dd272ade",
+  "upstream/zoology/mixers/nystromformer/attn.py": "d55b1f8c3da6373d65f332efb0982752a0941dae01f9a368d0138cc41cc6aa91",
+  "upstream/zoology/mixers/nystromformer/attn_mask.py": "8c742f0943663b1e372ceab69fd6f0d22c046632cd501d1148015a5acdd3f73a",
+  "upstream/zoology/mixers/nystromformer/core.py": "a2767ad965e59a00dfef84c86754488d7f9f03fa38591e66f2b76668323428cb",
+  "upstream/zoology/mixers/nystromformer/nystromformer.py": "9fba6069a1aa7152ab6a8e76199ec9ccd28c6eb2f8a9fb4591d8e4428b9952b0",
+  "upstream/zoology/mixers/nystromformer/ops.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/nystromformer/utils.py": "7bd8fe104fa3c29ef6593e5095395f4a1f09c6fa080bc6daccb71ad6c07b8946",
+  "upstream/zoology/mixers/rwkv.py": "ed4e3b48aa94618006500a3e197127eaac2e8d4f0dae5ce36797c8984f75f266",
+  "upstream/zoology/mixers/rwkv/v4/wkv_cuda.cu": "1e74c2b9bc9917bf7ce55aa05b38ce5038485e7b7c787d21eb98103836a32ab4",
+  "upstream/zoology/mixers/rwkv/v4/wkv_op.cpp": "f9bcfbc615fa7d9e6623a9b91f0b802715b3814eb1c50595f41234d775f6cc10",
+  "upstream/zoology/mixers/rwkv/v5/wkv5_cuda.cu": "9b76f9bf7958cef301ff49d445ceca031a21e485fbec4453e801fbcbde6b6e45",
+  "upstream/zoology/mixers/rwkv/v5/wkv5_op.cpp": "2fc8efa6c6a50abee0849dbe6c7596483466de9d9098d42312983b2af45c8f6f",
+  "upstream/zoology/mixers/rwkv5.py": "bdbe6dd5de9274097c1c9eb52fce49ba7a75bdbac15210e21c45b67af0544116",
+  "upstream/zoology/mixers/rwkv7.py": "51fc5b7f7632a840bbd1866eb03146647b784e6e0696d8e019f0075b195d211a",
+  "upstream/zoology/mixers/scatterbrain/__init__.py": "e9ea7d53368d1e7994249c2c0fa5ca7dfa2961995dbbe11724870e0989afae19",
+  "upstream/zoology/mixers/scatterbrain/attn.py": "1676f9e02abaeda31eb65b594c4b37d20c194f08c4dc719a44937d6ea70daa63",
+  "upstream/zoology/mixers/scatterbrain/feature_maps_sb.py": "435341a1fae3ec18d28d1c59ef76fd7ddaa31e7790a731f69a2ed0614f7cdc54",
+  "upstream/zoology/mixers/scatterbrain/masking.py": "13f16706ce8cb21e3e457e9c561cca0695757b05ef83ad28a332d115dbceb37a",
+  "upstream/zoology/mixers/scatterbrain/projection_utils.py": "58361c02501e0f3947c3d978c9789f63caa65edc6c5abd35f60f0b5d95d647ba",
+  "upstream/zoology/mixers/scatterbrain/scatterbrain_utils.py": "6f836e9832ca563039bb752c50c7bc4b84bd7a03125573cc54d1340eef5ef0d5",
+  "upstream/zoology/mixers/scatterbrain_new.py": "67a3521b4607c6320b37d81d3826abd293444a6c72c8715f7a18f9fad872973c",
+  "upstream/zoology/mixers/selective.py": "cd2d58ae0ad53c2278f9437e3be871e215eb5a72d125ebf45e3ca2a5b1c99a3b",
+  "upstream/zoology/mixers/slide_attn.py": "d7af8113f3cd579c1337f306f47b7c79c820c66aff509c82572fbfbc1f3b33fb",
+  "upstream/zoology/mixers/ttt.py": "c75ff49adccee87198b0b8815fc3e264684c03c10bc46b87bb1d3ec6d1daba2a",
+  "upstream/zoology/model.py": "ec29777ff3f4ba7ac91b440a860c8769a6e9b8471a08a84d3e19a36488170fcb",
+  "upstream/zoology/train.py": "18128f75f468539ea725a4391028ea313c20b2f644530610354db930f74e4658",
+  "upstream/zoology/utils.py": "0bca95c777dfe73806895dac12efe5d0c4fda1edba19810a29866f5565891f57"
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_attention_s13_lr4e4_paced_v1_background/source_snapshot_minimal.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c159d170a06e75129ca08b433ed67cc2e58f16e61998d4ac3c379694288781f2
+size 72647

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_attention_s13_lr4e4_paced_v1_background/source_subset_manifest.json

@@ -0,0 +1,271 @@
+{
+  "original_snapshot_sha256": "3599624aea58f1a45c412494563bebf43e97284a36aa68b00edc57a7260c1048",
+  "published_subset_sha256": "c159d170a06e75129ca08b433ed67cc2e58f16e61998d4ac3c379694288781f2",
+  "included_exact_bytes": [
+    {
+      "path": "code/discretization_mixing/__init__.py",
+      "sha256": "55f93431b8e7bff41a44bbb79c1648a5bbdef2a93c4e9ecb4679c894f29f5d69",
+      "bytes": 83
+    },
+    {
+      "path": "code/discretization_mixing/core.py",
+      "sha256": "5863bf8dca6d233a209b5a36598f59154fe50e2f544b6a503ed09eee65187c71",
+      "bytes": 4762
+    },
+    {
+      "path": "code/discretization_mixing/coupled.py",
+      "sha256": "802c51172f9a27d69f347424e877d2cbc24c4a0290749fd2be5aa90f425a4261",
+      "bytes": 29828
+    },
+    {
+      "path": "code/discretization_mixing/emission_anchor.py",
+      "sha256": "da271fda1756cea05aa0d3b7ae1eed37a2d02613b1eeab361e714ae827186085",
+      "bytes": 32529
+    },
+    {
+      "path": "code/discretization_mixing/gauge.py",
+      "sha256": "c964aaefe68eee5fc13a0acbea0e038e2d7f65c93314c9cdec617594598eae05",
+      "bytes": 6869
+    },
+    {
+      "path": "code/discretization_mixing/models.py",
+      "sha256": "104a3ad97ec72c1ecedd292c60a84bded62672b625eba2a242ba8ecb66669ec0",
+      "bytes": 8644
+    },
+    {
+      "path": "code/discretization_mixing/poststate_replay.py",
+      "sha256": "21ac93d5ad61a5fdc4d79db0fcb33c513786b1abc2d12f6746c2e46702e107b6",
+      "bytes": 32946
+    },
+    {
+      "path": "code/discretization_mixing/poststate_replay_graph.py",
+      "sha256": "4bd496200c4783c4d4c736a005724053addb9da403b7d416a690ebcdd23eb664",
+      "bytes": 33583
+    },
+    {
+      "path": "code/discretization_mixing/preflight.py",
+      "sha256": "a15acc29f83ff6cf6a03b58a8df802dbd3ea74038f8eda2b83b98265ae586a2b",
+      "bytes": 2697
+    },
+    {
+      "path": "code/discretization_mixing/retimed_models.py",
+      "sha256": "dd1bbf697626c8daa9a4a6a0273b005a8c362e2ce1f310450106eb782e0104ff",
+      "bytes": 23950
+    },
+    {
+      "path": "code/discretization_mixing/run.py",
+      "sha256": "1920751b7bccfca56badee1a6e3718df5a6f5f41f6b87171974e29bd88ce63a3",
+      "bytes": 10731
+    },
+    {
+      "path": "code/discretization_mixing/tasks.py",
+      "sha256": "46ad130e70a352c8aeae975abd55198ec0afe0835ce1e833ccc9f1a6822f6dd9",
+      "bytes": 3260
+    },
+    {
+      "path": "code/discretization_mixing/verify.py",
+      "sha256": "1d2242e53b6793b6782275b782f2a895dae959173483a5a465027ff283e812fd",
+      "bytes": 4417
+    },
+    {
+      "path": "tools/__init__.py",
+      "sha256": "9798da858190f4f16d85d4d4804cde32cb73df831e509f93e2028ec75831d981",
+      "bytes": 36
+    },
+    {
+      "path": "tools/benchmarks/__init__.py",
+      "sha256": "871c0f71154e97f70b97d89123e297267134e6dfc98e37f4b8fe8710f3bb4fd2",
+      "bytes": 75
+    },
+    {
+      "path": "tools/benchmarks/run_zoology_mqar.py",
+      "sha256": "374cc4831dd6bdf27ae37f1915e7498cab199f3bbaef647d2dfe0f7b274b3d7e",
+      "bytes": 34081
+    },
+    {
+      "path": "tools/benchmarks/run_zoology_mqar_paced.py",
+      "sha256": "62a6ae9528bc75dd251567b4b26d508b0bced4e43e3cab32c4394328abb8b13b",
+      "bytes": 1969
+    },
+    {
+      "path": "tools/research_audit/__init__.py",
+      "sha256": "03cb7cd7d94757ca20e8ed1b151a996f5b29e5b369f25afcf1504f13e23b0317",
+      "bytes": 69
+    },
+    {
+      "path": "tools/research_audit/fast_tasks.py",
+      "sha256": "80d5395e841e939c64523002dd83aba14fa41000f23f306fbabc6e446ba205c2",
+      "bytes": 13280
+    }
+  ],
+  "omitted_paths": [
+    "tests/test_zoology_adapter.py",
+    "upstream/LICENSE.md",
+    "upstream/README.md",
+    "upstream/setup.py",
+    "upstream/usage.md",
+    "upstream/zoology/__init__.py",
+    "upstream/zoology/analysis/__init__.py",
+    "upstream/zoology/analysis/capacity/mqar_fact_capacity.py",
+    "upstream/zoology/analysis/capacity/mqar_repro_plots.py",
+    "upstream/zoology/analysis/mqar_plotting_example.py",
+    "upstream/zoology/analysis/paper/based_paper/based_figure1.py",
+    "upstream/zoology/analysis/paper/based_paper/based_wall_clock.py",
+    "upstream/zoology/analysis/paper/sabri/01-25_num_kv.py",
+    "upstream/zoology/analysis/paper/sabri/01-26_tradeoff.py",
+    "upstream/zoology/analysis/paper/sabri/01-27_traeoff.py",
+    "upstream/zoology/analysis/paper/zoology_paper/mqar_d_model.py",
+    "upstream/zoology/analysis/paper/zoology_paper/mqar_taylor.py",
+    "upstream/zoology/analysis/paper/zoology_paper/mqar_taylor_kv.py",
+    "upstream/zoology/analysis/paper/zoology_paper/num_kv.py",
+    "upstream/zoology/analysis/paper/zoology_paper/zoology_figure2.py",
+    "upstream/zoology/analysis/utils.py",
+    "upstream/zoology/config.py",
+    "upstream/zoology/data/__init__.py",
+    "upstream/zoology/data/ar_extrapolate.py",
+    "upstream/zoology/data/circuits.py",
+    "upstream/zoology/data/compositional_mqar.py",
+    "upstream/zoology/data/forgetting_mqar.py",
+    "upstream/zoology/data/multiquery_ar.py",
+    "upstream/zoology/data/stacked_mqar.py",
+    "upstream/zoology/data/utils.py",
+    "upstream/zoology/experiments/011126/mqar_continuous.py",
+    "upstream/zoology/experiments/011126/mqar_continuous_mse_loss.py",
+    "upstream/zoology/experiments/__init__.py",
+    "upstream/zoology/experiments/basic_examples/__init__.py",
+    "upstream/zoology/experiments/basic_examples/basic.py",
+    "upstream/zoology/experiments/basic_examples/basic_sweep.py",
+    "upstream/zoology/experiments/models_repo.py",
+    "upstream/zoology/experiments/mqar_example_configs/composition_configs.py",
+    "upstream/zoology/experiments/mqar_example_configs/composition_configs_random_false.py",
+    "upstream/zoology/experiments/mqar_example_configs/forgetting_configs.py",
+    "upstream/zoology/experiments/mqar_example_configs/mqar_configs_random_false.py",
+    "upstream/zoology/experiments/mqar_example_configs/original_mqar_configs.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-26_extrap.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-27_feature_map.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-27_tradeoff.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-28_taylor_low.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-31_tradeoff.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-01_sliding.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-09_harder_yet.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-09_new_feature_maps.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/__init__.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/mqar_taylor_kv.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_appendix/configs.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_appendix/plot.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/README.md",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/configs.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/plot.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_figure3/configs.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_figure3/plot.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/binary_majority.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/configs.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/majority.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/parity.py",
+    "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_dmodel.py",
+    "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_taylor.py",
+    "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_taylor_kv.py",
+    "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/README.md",
+    "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/configs.py",
+    "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/plot.py",
+    "upstream/zoology/launch.py",
+    "upstream/zoology/logger.py",
+    "upstream/zoology/metrics.py",
+    "upstream/zoology/mixers/__init__.py",
+    "upstream/zoology/mixers/attention.py",
+    "upstream/zoology/mixers/base_conv.py",
+    "upstream/zoology/mixers/based.py",
+    "upstream/zoology/mixers/bigbird.py",
+    "upstream/zoology/mixers/convolution.py",
+    "upstream/zoology/mixers/deepseek/local_attention.py",
+    "upstream/zoology/mixers/deepseek/rotary.py",
+    "upstream/zoology/mixers/deepseek_nsa.py",
+    "upstream/zoology/mixers/delta_net.py",
+    "upstream/zoology/mixers/feature_maps/__init__.py",
+    "upstream/zoology/mixers/feature_maps/all_poly.py",
+    "upstream/zoology/mixers/feature_maps/base.py",
+    "upstream/zoology/mixers/feature_maps/cosformer.py",
+    "upstream/zoology/mixers/feature_maps/exp_dim.py",
+    "upstream/zoology/mixers/feature_maps/performer.py",
+    "upstream/zoology/mixers/feature_maps/taylor.py",
+    "upstream/zoology/mixers/gated_delta_net.py",
+    "upstream/zoology/mixers/gla.py",
+    "upstream/zoology/mixers/h3/__init__.py",
+    "upstream/zoology/mixers/h3/dplr.py",
+    "upstream/zoology/mixers/h3/h3.py",
+    "upstream/zoology/mixers/h3/hippo.py",
+    "upstream/zoology/mixers/h3/ops/__init__.py",
+    "upstream/zoology/mixers/h3/ops/fftconv.py",
+    "upstream/zoology/mixers/h3/ops/krylov.py",
+    "upstream/zoology/mixers/h3/ops/toeplitz.py",
+    "upstream/zoology/mixers/h3/ops/vandermonde.py",
+    "upstream/zoology/mixers/h3/ss_kernel.py",
+    "upstream/zoology/mixers/h3/ss_kernel_diag.py",
+    "upstream/zoology/mixers/h3/ss_kernel_shift.py",
+    "upstream/zoology/mixers/h3/ssm_utils.py",
+    "upstream/zoology/mixers/hybrid.py",
+    "upstream/zoology/mixers/hyena.py",
+    "upstream/zoology/mixers/listing.py",
+    "upstream/zoology/mixers/mamba.py",
+    "upstream/zoology/mixers/mamba2.py",
+    "upstream/zoology/mixers/mamba_ssm/__init__.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/__init__.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/selective_scan_interface.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/__init__.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/k_activations.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/layer_norm.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/layernorm.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/layernorm_gated.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/selective_state_update.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/softplus.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_bmm.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_chunk_scan.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_chunk_state.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_combined.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_state_passing.py",
+    "upstream/zoology/mixers/mamba_ssm/selective_scan_interface.py",
+    "upstream/zoology/mixers/mamba_ssm/triton/__init__.py",
+    "upstream/zoology/mixers/mamba_ssm/triton/layernorm.py",
+    "upstream/zoology/mixers/mamba_ssm/triton/selective_state_update.py",
+    "upstream/zoology/mixers/mlp.py",
+    "upstream/zoology/mixers/mra/__init__.py",
+    "upstream/zoology/mixers/mra/attention.py",
+    "upstream/zoology/mixers/mra/autograd_function.py",
+    "upstream/zoology/mixers/mra/cuda/cuda_kernel.cu",
+    "upstream/zoology/mixers/mra/cuda/cuda_kernel.h",
+    "upstream/zoology/mixers/mra/cuda/cuda_launch.cu",
+    "upstream/zoology/mixers/mra/cuda/cuda_launch.h",
+    "upstream/zoology/mixers/mra/cuda/torch_extension.cpp",
+    "upstream/zoology/mixers/mra/kernel.py",
+    "upstream/zoology/mixers/mra/mra.py",
+    "upstream/zoology/mixers/nysfromformer.py",
+    "upstream/zoology/mixers/nystromformer/__init__.py",
+    "upstream/zoology/mixers/nystromformer/attn.py",
+    "upstream/zoology/mixers/nystromformer/attn_mask.py",
+    "upstream/zoology/mixers/nystromformer/core.py",
+    "upstream/zoology/mixers/nystromformer/nystromformer.py",
+    "upstream/zoology/mixers/nystromformer/ops.py",
+    "upstream/zoology/mixers/nystromformer/utils.py",
+    "upstream/zoology/mixers/rwkv.py",
+    "upstream/zoology/mixers/rwkv/v4/wkv_cuda.cu",
+    "upstream/zoology/mixers/rwkv/v4/wkv_op.cpp",
+    "upstream/zoology/mixers/rwkv/v5/wkv5_cuda.cu",
+    "upstream/zoology/mixers/rwkv/v5/wkv5_op.cpp",
+    "upstream/zoology/mixers/rwkv5.py",
+    "upstream/zoology/mixers/rwkv7.py",
+    "upstream/zoology/mixers/scatterbrain/__init__.py",
+    "upstream/zoology/mixers/scatterbrain/attn.py",
+    "upstream/zoology/mixers/scatterbrain/feature_maps_sb.py",
+    "upstream/zoology/mixers/scatterbrain/masking.py",
+    "upstream/zoology/mixers/scatterbrain/projection_utils.py",
+    "upstream/zoology/mixers/scatterbrain/scatterbrain_utils.py",
+    "upstream/zoology/mixers/scatterbrain_new.py",
+    "upstream/zoology/mixers/selective.py",
+    "upstream/zoology/mixers/slide_attn.py",
+    "upstream/zoology/mixers/ttt.py",
+    "upstream/zoology/model.py",
+    "upstream/zoology/train.py",
+    "upstream/zoology/utils.py"
+  ],
+  "scope": "Project source and attributed Apache SISO subset only; upstream/vendor trees omitted. The original complete ZIP is retained locally, NOT redistributed or silently replaced."
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_attention_s13_lr4e4_paced_v1_background/status_completed.json

@@ -0,0 +1,4 @@
+{
+  "scope": "one_official_ICLR24_Figure2_data_training_cell",
+  "status": "completed"
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_attention_s13_lr4e4_paced_v1_background/status_started.json

@@ -0,0 +1,30 @@
+{
+  "args": {
+    "allow_full": true,
+    "architecture": "upstream_attention",
+    "batch_delay_seconds": 0.1,
+    "chunk": 32,
+    "cpu_threads": 4,
+    "data_seed": 123,
+    "device": "cuda",
+    "heads": 4,
+    "implementation": "stable",
+    "lr": 0.00046415888336127773,
+    "native_failure_artifact": "results\\benchmark_setup_20261002\\windows_native_seed_failure.json",
+    "output_dir": "results\\zoology_mqar\\v100_full_iclr24_L64_P4_attention_s13_lr4e4_paced_v1_background",
+    "profile": "full",
+    "seed": 13,
+    "seq_len": 64,
+    "state_size": 16,
+    "upstream": "<workspace>\\.cache\\upstream\\zoology",
+    "width": 64
+  },
+  "status": "started",
+  "time_utc": "2026-10-02T18:28:44.468326+00:00",
+  "upstream": {
+    "clean": true,
+    "commit": "1ad20d193b6113cae1e8f3c655c300d7b4b3f4bb",
+    "path": "<workspace>\\.cache\\upstream\\zoology",
+    "status": ""
+  }
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e2_paced_v2/checkpoint_final.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b8bf7daff50585c01648ca731c85a2364f9fd087881fe4fa631639e37dd4adda
+size 13617805

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e2_paced_v2/data_generation_provenance.json

@@ -0,0 +1,47 @@
+{
+  "actual_split_seeds": {
+    "test": [
+      3062119789
+    ],
+    "train": [
+      843828734
+    ]
+  },
+  "concurrency": "No concurrent data generation in this process",
+  "deviation": "Only prepare_data scope: absent np.random.randint dtype becomes np.int64; explicit dtype preserved",
+  "expected_randomstate_int64_split_seeds": {
+    "test": [
+      3062119789
+    ],
+    "train": [
+      843828734
+    ]
+  },
+  "preserved_native_failure": {
+    "path": "<workspace>\\results\\benchmark_setup_20261002\\windows_native_seed_failure.json",
+    "sha256": "f9f84844b043c27d9c0ada21cb6ed3410a927ad5fa1a6794b32c35ee468a832c"
+  },
+  "reason": "Windows default int32 rejects upstream test seed high=2**32",
+  "rng_api_restored": true,
+  "seed_draws": [
+    {
+      "dtype": "int64",
+      "high": 2147483648,
+      "low": 0,
+      "values": [
+        843828734
+      ]
+    },
+    {
+      "dtype": "int64",
+      "high": 4294967296,
+      "low": 2147483648,
+      "values": [
+        3062119789
+      ]
+    }
+  ],
+  "torch_random_nonquery_policy": "Original upstream torch.randint, no patch",
+  "vendor_source_modified": false,
+  "windows_compatibility_active": true
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e2_paced_v2/dataset_manifest.json

@@ -0,0 +1,34 @@
+{
+  "test": [
+    {
+      "inputs_sha256": "6dc295fac235e050fe7de3dc95344ac8b6057198db94d1da352f0fb910815ac5",
+      "labels_sha256": "4dd213f03b52fdde7a4f14051c1d131ae48bf6d3cfdc70f1127c9ab035ee3690",
+      "segment": 0,
+      "shape": [
+        3000,
+        64
+      ],
+      "slices": {
+        "input_seq_len": 64,
+        "num_kv_pairs": 4,
+        "num_passes": 1
+      }
+    }
+  ],
+  "train": [
+    {
+      "inputs_sha256": "e2ea685b00cd20110aa6fb97b0f8eaaa9b260b64c3c1176a017033cbf5d192a1",
+      "labels_sha256": "1bd7f13dcf6a7cbe73c21759801720c54b630e2e90d31f76fb6addecc0844691",
+      "segment": 0,
+      "shape": [
+        100000,
+        64
+      ],
+      "slices": {
+        "input_seq_len": 64,
+        "num_kv_pairs": 4,
+        "num_passes": 1
+      }
+    }
+  ]
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e2_paced_v2/effective_config.json

@@ -0,0 +1,159 @@
+{
+  "actual_data": {
+    "batch_size": 512,
+    "cache_dir": null,
+    "num_passes": 1,
+    "seed": 123,
+    "test_segments": [
+      {
+        "include_slices": true,
+        "input_seq_len": 64,
+        "name": "multiquery_ar",
+        "num_examples": 3000,
+        "num_kv_pairs": 4,
+        "power_a": 0.01,
+        "random_non_queries": false,
+        "vocab_size": 8192
+      }
+    ],
+    "train_segments": [
+      {
+        "include_slices": true,
+        "input_seq_len": 64,
+        "name": "multiquery_ar",
+        "num_examples": 100000,
+        "num_kv_pairs": 4,
+        "power_a": 0.01,
+        "random_non_queries": false,
+        "vocab_size": 8192
+      }
+    ]
+  },
+  "actual_model": {
+    "architecture": "project_endpoint",
+    "bc_bias": true,
+    "chunk": 32,
+    "heads": 4,
+    "implementation": "stable",
+    "layers": 2,
+    "official_mamba": false,
+    "parameter_counts": {
+      "active_trainable": 1099552,
+      "bank_total": 1100072,
+      "caution": "Shared initialization is exact; active parameter counts are not identical.",
+      "inactive_modules": [
+        "current_proj"
+      ]
+    },
+    "skip_source": "legacy",
+    "state_size": 16,
+    "values": 8192,
+    "vocab": 8192,
+    "width": 64
+  },
+  "comparison_scope": "project SSM arms are not official Mamba/Mamba-3",
+  "data_compatibility_policy": "Official prepare_data with scoped Windows default-int64 randint bridge",
+  "epoch_checkpoint_policy": "Finite flushed validation logger callback, before earlystop/scheduler.step; recovery only, not certified exact resume",
+  "initialization_bank": {
+    "equal": true,
+    "rng_state_sha256": "0efb7d38556dccd703b9e84e9501729e409f0a7d4604081bedd991a65756862e",
+    "state_sha256": {
+      "project_endpoint": "82555db6e36c97a581c8a6880b023888a01b6ff75e9a3212d2f36cd5584e346e",
+      "project_retimed": "82555db6e36c97a581c8a6880b023888a01b6ff75e9a3212d2f36cd5584e346e"
+    }
+  },
+  "label_policy": "original token IDs, full vocabulary CE, ignore_index=-100",
+  "model_config_scope": "TrainConfig.model is metadata; actual_model is authoritative for project arms",
+  "observability_guards": "Full-logit finite hook, nonfinite-metric stop, final parameter/optimizer finite audit; no optimizer changes",
+  "profile": {
+    "lr_grid": [
+      0.0001,
+      0.00046415888336127773,
+      0.002154434690031882,
+      0.01
+    ],
+    "max_epochs": 64,
+    "operational_override": {
+      "cache_dir": null
+    },
+    "requested_factory_kwargs": {
+      "num_kv_pairs": 4,
+      "random_non_queries": false,
+      "test_power_a": 0.01,
+      "train_power_a": 0.01
+    },
+    "scope": "one_official_ICLR24_Figure2_data_training_cell",
+    "selected_cell": [
+      64,
+      4
+    ],
+    "source": "zoology/experiments/paper_configs/iclr24_zoology_figure2/configs.py"
+  },
+  "train_config": {
+    "data": {
+      "batch_size": 512,
+      "cache_dir": null,
+      "force_cache": false,
+      "num_passes": 1,
+      "seed": 123,
+      "test_configs": [
+        {
+          "input_seq_len": 64,
+          "num_examples": 3000,
+          "vocab_size": 8192
+        }
+      ],
+      "train_configs": [
+        {
+          "input_seq_len": 64,
+          "num_examples": 100000,
+          "vocab_size": 8192
+        }
+      ]
+    },
+    "early_stopping_metric": "valid/accuracy",
+    "early_stopping_threshold": 0.99,
+    "input_type": "discrete",
+    "launch_id": null,
+    "learning_rate": 0.01,
+    "logger": {
+      "entity": null,
+      "project_name": null
+    },
+    "loss_type": "ce",
+    "max_epochs": 64,
+    "model": {
+      "block_type": "TransformerBlock",
+      "d_model": 64,
+      "drop_path": 0.0,
+      "embed_dropout": 0.1,
+      "embedding_init_type": "default",
+      "layer_norm_epsilon": 1e-05,
+      "learnable_word_embeddings": true,
+      "max_position_embeddings": 64,
+      "multiplier": 1,
+      "n_layers": 2,
+      "name": "project_endpoint",
+      "pad_vocab_size_multiple": 1,
+      "resid_dropout": 0.0,
+      "sequence_mixer": {
+        "kwargs": {
+          "dropout": 0.1,
+          "num_heads": 1
+        },
+        "name": "zoology.mixers.attention.MHA"
+      },
+      "state_mixer": {
+        "kwargs": {},
+        "name": "torch.nn.Identity"
+      },
+      "vocab_size": 8192
+    },
+    "run_id": "project_endpoint",
+    "seed": 11,
+    "slice_keys": [],
+    "sweep_id": null,
+    "weight_decay": 0.1
+  },
+  "training_policy": "unchanged upstream Trainer.fit/compute_loss/test/compute_metrics"
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e2_paced_v2/environment_after.json

@@ -0,0 +1,61 @@
+{
+  "default_dtype": "torch.float32",
+  "device_requested": "cuda",
+  "executable": "<workspace>\\.venv-v100\\Scripts\\python.exe",
+  "gpu_name": "Tesla V100-SXM2-16GB",
+  "gpu_properties": "_CudaDeviceProperties(name='Tesla V100-SXM2-16GB', major=7, minor=0, total_memory=16242MB, multi_processor_count=80, uuid=d13b7041-55e8-4532-2fb1-f4bd3f80c13f, pci_bus_id=40, pci_device_id=0, pci_domain_id=0, L2_cache_size=6MB)",
+  "num_threads": 4,
+  "packages": {
+    "GitPython": "3.2.0",
+    "Jinja2": "3.1.6",
+    "MarkupSafe": "3.0.3",
+    "PyYAML": "6.0.3",
+    "Pygments": "2.21.0",
+    "annotated-types": "0.8.0",
+    "certifi": "2026.7.22",
+    "charset-normalizer": "3.5.2",
+    "click": "8.5.0",
+    "colorama": "0.4.6",
+    "einops": "0.8.1",
+    "filelock": "4.0.9",
+    "fsspec": "2026.9.0",
+    "gitdb": "4.0.12",
+    "idna": "3.20",
+    "iniconfig": "2.3.0",
+    "mpmath": "1.3.0",
+    "networkx": "3.7",
+    "numpy": "2.2.6",
+    "packaging": "26.3",
+    "pandas": "2.3.3",
+    "pillow": "11.3.0",
+    "pip": "25.0.1",
+    "platformdirs": "4.12.2",
+    "pluggy": "1.6.0",
+    "protobuf": "6.33.6",
+    "pydantic": "2.11.7",
+    "pydantic_core": "2.33.2",
+    "pytest": "8.4.1",
+    "python-dateutil": "2.9.0.post0",
+    "pytz": "2026.4",
+    "requests": "2.34.2",
+    "sentry-sdk": "2.71.0",
+    "setuptools": "84.0.0",
+    "six": "1.17.0",
+    "smmap": "5.0.3",
+    "sympy": "1.14.0",
+    "torch": "2.9.1+cu126",
+    "torchvision": "0.24.1+cu126",
+    "tqdm": "4.67.1",
+    "typing-inspection": "0.4.4",
+    "typing_extensions": "4.16.0",
+    "tzdata": "2026.4",
+    "urllib3": "2.8.0",
+    "wandb": "0.23.0"
+  },
+  "platform": "Windows-11-10.0.26200-SP0",
+  "python": "3.13.3 (tags/v3.13.3:6280bb5, Apr  8 2025, 14:47:33) [MSC v.1943 64 bit (AMD64)]",
+  "torch": "2.9.1+cu126",
+  "torch_cuda": "12.6",
+  "wandb_disabled": "true",
+  "wandb_mode": "disabled"
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e2_paced_v2/environment_before.json

@@ -0,0 +1,61 @@
+{
+  "default_dtype": "torch.float32",
+  "device_requested": "cuda",
+  "executable": "<workspace>\\.venv-v100\\Scripts\\python.exe",
+  "gpu_name": "Tesla V100-SXM2-16GB",
+  "gpu_properties": "_CudaDeviceProperties(name='Tesla V100-SXM2-16GB', major=7, minor=0, total_memory=16242MB, multi_processor_count=80, uuid=d13b7041-55e8-4532-2fb1-f4bd3f80c13f, pci_bus_id=40, pci_device_id=0, pci_domain_id=0, L2_cache_size=6MB)",
+  "num_threads": 4,
+  "packages": {
+    "GitPython": "3.2.0",
+    "Jinja2": "3.1.6",
+    "MarkupSafe": "3.0.3",
+    "PyYAML": "6.0.3",
+    "Pygments": "2.21.0",
+    "annotated-types": "0.8.0",
+    "certifi": "2026.7.22",
+    "charset-normalizer": "3.5.2",
+    "click": "8.5.0",
+    "colorama": "0.4.6",
+    "einops": "0.8.1",
+    "filelock": "4.0.9",
+    "fsspec": "2026.9.0",
+    "gitdb": "4.0.12",
+    "idna": "3.20",
+    "iniconfig": "2.3.0",
+    "mpmath": "1.3.0",
+    "networkx": "3.7",
+    "numpy": "2.2.6",
+    "packaging": "26.3",
+    "pandas": "2.3.3",
+    "pillow": "11.3.0",
+    "pip": "25.0.1",
+    "platformdirs": "4.12.2",
+    "pluggy": "1.6.0",
+    "protobuf": "6.33.6",
+    "pydantic": "2.11.7",
+    "pydantic_core": "2.33.2",
+    "pytest": "8.4.1",
+    "python-dateutil": "2.9.0.post0",
+    "pytz": "2026.4",
+    "requests": "2.34.2",
+    "sentry-sdk": "2.71.0",
+    "setuptools": "84.0.0",
+    "six": "1.17.0",
+    "smmap": "5.0.3",
+    "sympy": "1.14.0",
+    "torch": "2.9.1+cu126",
+    "torchvision": "0.24.1+cu126",
+    "tqdm": "4.67.1",
+    "typing-inspection": "0.4.4",
+    "typing_extensions": "4.16.0",
+    "tzdata": "2026.4",
+    "urllib3": "2.8.0",
+    "wandb": "0.23.0"
+  },
+  "platform": "Windows-11-10.0.26200-SP0",
+  "python": "3.13.3 (tags/v3.13.3:6280bb5, Apr  8 2025, 14:47:33) [MSC v.1943 64 bit (AMD64)]",
+  "torch": "2.9.1+cu126",
+  "torch_cuda": "12.6",
+  "wandb_disabled": "true",
+  "wandb_mode": "disabled"
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e2_paced_v2/execution_provenance.json

@@ -0,0 +1,34 @@
+{
+  "imported_modules": {
+    "discretization_mixing": "<workspace>\\code\\discretization_mixing\\__init__.py",
+    "discretization_mixing.core": "<workspace>\\code\\discretization_mixing\\core.py",
+    "discretization_mixing.coupled": "<workspace>\\code\\discretization_mixing\\coupled.py",
+    "discretization_mixing.gauge": "<workspace>\\code\\discretization_mixing\\gauge.py",
+    "discretization_mixing.models": "<workspace>\\code\\discretization_mixing\\models.py",
+    "discretization_mixing.retimed_models": "<workspace>\\code\\discretization_mixing\\retimed_models.py",
+    "zoology": "<workspace>\\.cache\\upstream\\zoology\\zoology\\__init__.py",
+    "zoology.config": "<workspace>\\.cache\\upstream\\zoology\\zoology\\config.py",
+    "zoology.data": "<workspace>\\.cache\\upstream\\zoology\\zoology\\data\\__init__.py",
+    "zoology.data.multiquery_ar": "<workspace>\\.cache\\upstream\\zoology\\zoology\\data\\multiquery_ar.py",
+    "zoology.data.utils": "<workspace>\\.cache\\upstream\\zoology\\zoology\\data\\utils.py",
+    "zoology.logger": "<workspace>\\.cache\\upstream\\zoology\\zoology\\logger.py",
+    "zoology.metrics": "<workspace>\\.cache\\upstream\\zoology\\zoology\\metrics.py",
+    "zoology.model": "<workspace>\\.cache\\upstream\\zoology\\zoology\\model.py",
+    "zoology.train": "<workspace>\\.cache\\upstream\\zoology\\zoology\\train.py",
+    "zoology.utils": "<workspace>\\.cache\\upstream\\zoology\\zoology\\utils.py"
+  },
+  "source_snapshot_sha256": "1d70a5cbfcb041f5d44d220b60f7eb8cee18850b9b1e442b0c98d76cc7c7cfc4",
+  "source_stable": true,
+  "upstream_after": {
+    "clean": true,
+    "commit": "1ad20d193b6113cae1e8f3c655c300d7b4b3f4bb",
+    "path": "<workspace>\\.cache\\upstream\\zoology",
+    "status": ""
+  },
+  "upstream_before": {
+    "clean": true,
+    "commit": "1ad20d193b6113cae1e8f3c655c300d7b4b3f4bb",
+    "path": "<workspace>\\.cache\\upstream\\zoology",
+    "status": ""
+  }
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e2_paced_v2/final_summary.json

@@ -0,0 +1,11 @@
+{
+  "accuracy": 0.9273333333333333,
+  "architecture": "project_endpoint",
+  "last_upstream_validation": {
+    "epoch": 63,
+    "valid/accuracy": 0.9273333333333333,
+    "valid/loss": 0.35700923204421997
+  },
+  "scope": "one_official_ICLR24_Figure2_data_training_cell",
+  "sequences": 3000
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e2_paced_v2/finite_audit.json

@@ -0,0 +1,11 @@
+{
+  "final_state": {
+    "finite": true,
+    "nonfinite_paths": [],
+    "tensor_count": 152
+  },
+  "outputs": {
+    "forward_calls": 12934,
+    "full_logits_finite": true
+  }
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e2_paced_v2/source_manifest_after.json

@@ -0,0 +1,188 @@
+{
+  "code/discretization_mixing/__init__.py": "55f93431b8e7bff41a44bbb79c1648a5bbdef2a93c4e9ecb4679c894f29f5d69",
+  "code/discretization_mixing/core.py": "5863bf8dca6d233a209b5a36598f59154fe50e2f544b6a503ed09eee65187c71",
+  "code/discretization_mixing/coupled.py": "802c51172f9a27d69f347424e877d2cbc24c4a0290749fd2be5aa90f425a4261",
+  "code/discretization_mixing/emission_anchor.py": "da271fda1756cea05aa0d3b7ae1eed37a2d02613b1eeab361e714ae827186085",
+  "code/discretization_mixing/gauge.py": "c964aaefe68eee5fc13a0acbea0e038e2d7f65c93314c9cdec617594598eae05",
+  "code/discretization_mixing/models.py": "104a3ad97ec72c1ecedd292c60a84bded62672b625eba2a242ba8ecb66669ec0",
+  "code/discretization_mixing/poststate_replay.py": "21ac93d5ad61a5fdc4d79db0fcb33c513786b1abc2d12f6746c2e46702e107b6",
+  "code/discretization_mixing/poststate_replay_graph.py": "4bd496200c4783c4d4c736a005724053addb9da403b7d416a690ebcdd23eb664",
+  "code/discretization_mixing/preflight.py": "a15acc29f83ff6cf6a03b58a8df802dbd3ea74038f8eda2b83b98265ae586a2b",
+  "code/discretization_mixing/retimed_models.py": "dd1bbf697626c8daa9a4a6a0273b005a8c362e2ce1f310450106eb782e0104ff",
+  "code/discretization_mixing/run.py": "1920751b7bccfca56badee1a6e3718df5a6f5f41f6b87171974e29bd88ce63a3",
+  "code/discretization_mixing/tasks.py": "46ad130e70a352c8aeae975abd55198ec0afe0835ce1e833ccc9f1a6822f6dd9",
+  "code/discretization_mixing/verify.py": "1d2242e53b6793b6782275b782f2a895dae959173483a5a465027ff283e812fd",
+  "tests/test_zoology_adapter.py": "f3888c21ab63ddeb0c1a98f801ae0d72010185dba6e10dbb9c06dedbbf675ca2",
+  "tools/__init__.py": "9798da858190f4f16d85d4d4804cde32cb73df831e509f93e2028ec75831d981",
+  "tools/benchmarks/__init__.py": "871c0f71154e97f70b97d89123e297267134e6dfc98e37f4b8fe8710f3bb4fd2",
+  "tools/benchmarks/run_zoology_mqar.py": "374cc4831dd6bdf27ae37f1915e7498cab199f3bbaef647d2dfe0f7b274b3d7e",
+  "tools/benchmarks/run_zoology_mqar_paced.py": "62a6ae9528bc75dd251567b4b26d508b0bced4e43e3cab32c4394328abb8b13b",
+  "tools/research_audit/__init__.py": "03cb7cd7d94757ca20e8ed1b151a996f5b29e5b369f25afcf1504f13e23b0317",
+  "tools/research_audit/fast_tasks.py": "80d5395e841e939c64523002dd83aba14fa41000f23f306fbabc6e446ba205c2",
+  "upstream/LICENSE.md": "9d9baa9d20e3c6094f555bcc8e1d000cd91c692709a7e99379a5886304d95eea",
+  "upstream/README.md": "f2444ed90224ac1d4091cb7e0e8f435a00d342f84cc1b989689d1f81fb37b96f",
+  "upstream/setup.py": "a0e6e928972015dbd65ff13577eb982aa9f2469e8de66ee472a941859c9813ed",
+  "upstream/usage.md": "ba24fab59fd2991a06468b7475ccbe57d7424e1a45f72ce00acd88d3c73dda7b",
+  "upstream/zoology/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/analysis/__init__.py": "995f279d1d190305f2ca7a43e090ed2e63a8be1aa16f9fe78bbc727d4baa73c1",
+  "upstream/zoology/analysis/capacity/mqar_fact_capacity.py": "6cf3e1f3a9b4cdab8f1b9d6d2ae8bc2778d396c5e4e7b9416fa954314389177c",
+  "upstream/zoology/analysis/capacity/mqar_repro_plots.py": "e9897daad0f78091939d7d988708810501594f4e6e92c406134c380e9881570a",
+  "upstream/zoology/analysis/mqar_plotting_example.py": "d59e78608231af34baa5baa02b21adec54ccf0ea406a47aaec553ed630527d32",
+  "upstream/zoology/analysis/paper/based_paper/based_figure1.py": "919dbcbc6e3098cc0f13acb0ef9ae289cf8cf8b078be9706e94d9ff59f1cf7d5",
+  "upstream/zoology/analysis/paper/based_paper/based_wall_clock.py": "192e111b3e02b28818ec4d10c89bfbb6b24c3afec635afbf7f66ee81176b4bae",
+  "upstream/zoology/analysis/paper/sabri/01-25_num_kv.py": "d1b8b113aed1fdd9bd021d40d90dd33baaae1f078ed2dcff96a24ce15479aae8",
+  "upstream/zoology/analysis/paper/sabri/01-26_tradeoff.py": "16fa0f3c39fb97d66eae6f9add72b9e78d11b30364ddc1eb8da1df183898d043",
+  "upstream/zoology/analysis/paper/sabri/01-27_traeoff.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/analysis/paper/zoology_paper/mqar_d_model.py": "be3cabc179a43c2019bb05f7a5a8dc4d35cd6c98a28af1814bdd91c184851eb7",
+  "upstream/zoology/analysis/paper/zoology_paper/mqar_taylor.py": "1762900e95d79332a00baf0180443013e780392088e740020fa9e84c5862c507",
+  "upstream/zoology/analysis/paper/zoology_paper/mqar_taylor_kv.py": "71c9fbaecbaa9a3263a14bcea92a3c3d6ab176244a3f0e20f56fbd2293420a26",
+  "upstream/zoology/analysis/paper/zoology_paper/num_kv.py": "9ffe1e9cce599fab39e116f61c36f83b5b1eb8879e0f382f0fa9e6471fe821e3",
+  "upstream/zoology/analysis/paper/zoology_paper/zoology_figure2.py": "940ccc8601f85abb4f6dd2deabcddc01d267f13f1da79660a6a8ad2c4c30eb42",
+  "upstream/zoology/analysis/utils.py": "290888694a9566fcbc519cf1d5ff42e5f295a0ceae1d079a8131704678c1d142",
+  "upstream/zoology/config.py": "6528d06a6a5f5cb167a843116a9d49cd3e9e3f7badc74c4f8a3f2a8faf4b9b91",
+  "upstream/zoology/data/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/data/ar_extrapolate.py": "4ade3204a92c3df781545b8748fca920ba137234ca2279ff3ece3ea52e00aa32",
+  "upstream/zoology/data/circuits.py": "c840251d356b429562aa042b8b0cab3be84c3c657d2511cb53ed7c1e408c3b38",
+  "upstream/zoology/data/compositional_mqar.py": "74d12d33d755c1bcce8c48cda56f179dc9c04d1b1abd509d5a1a26150329808f",
+  "upstream/zoology/data/forgetting_mqar.py": "fa20f397856b463ccc6b2fde4cf9b06a5f6256f70bd53f68be28e5a5e08d57b2",
+  "upstream/zoology/data/multiquery_ar.py": "d9d22c081a20f2da447d4d23cbde18c716e4f748b9e6236cb2d5adde796b3f29",
+  "upstream/zoology/data/stacked_mqar.py": "352b382941bd2c62cb638c6830f37454192abbc8fde59103c82b44449b5a360a",
+  "upstream/zoology/data/utils.py": "532170abcb36a086b2638e95796184e0f42612c66d4cc9bc4c34d892a5307c02",
+  "upstream/zoology/experiments/011126/mqar_continuous.py": "3c0b3241a5f20cd145b70ff5eb9b862d5f4254e773669d9427dd5508fb28fd86",
+  "upstream/zoology/experiments/011126/mqar_continuous_mse_loss.py": "32b968b1b0f4dab2c3de809e5dc0690c6353a0898c0ef27f7e2f59430470e555",
+  "upstream/zoology/experiments/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/experiments/basic_examples/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/experiments/basic_examples/basic.py": "69cbd3ec13ca98d13dc7c09799aa838a1411ced6ad8926268d241597d9befc54",
+  "upstream/zoology/experiments/basic_examples/basic_sweep.py": "f2b58f87447c487b3110e7be4d020b3eaab8c0a8e36eb80095c124e67d32e184",
+  "upstream/zoology/experiments/models_repo.py": "19e1c438fdfa88a538a78ad4edc822bc98d07642bc98092cfce6993f063217b8",
+  "upstream/zoology/experiments/mqar_example_configs/composition_configs.py": "e4d7eaf07954260edb407fe6d36d762b792f886d6017962c467a20df65f3c765",
+  "upstream/zoology/experiments/mqar_example_configs/composition_configs_random_false.py": "ee6843d320f6968563eaf708616ce8d5251b4ec699bcfcd89cf27d817c7384c8",
+  "upstream/zoology/experiments/mqar_example_configs/forgetting_configs.py": "5a1fdb058c5e7d04b5e4b6983478d428489c1291135ef3e4bad241ff3ab23629",
+  "upstream/zoology/experiments/mqar_example_configs/mqar_configs_random_false.py": "9ce23acde82665a56285ee4c98d8fbd0625e9acba34bcfda63dd291ab04f8fbc",
+  "upstream/zoology/experiments/mqar_example_configs/original_mqar_configs.py": "e599659b3b8d863de5946ec3cb037be9a7be9adf7eff73b52627e7f01db400cd",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-26_extrap.py": "412842831844afc4aca351fd58119c779a5735024626cc4c28dd6920652443d0",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-27_feature_map.py": "68d8ac3758082f132d229099fe5faad5052b579bb9c964288ffdda5e3a9c6213",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-27_tradeoff.py": "ad056f0282cb2a18f4bcb5096ce0d6f3aa351f032a9bd5b496626c369d899ef6",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-28_taylor_low.py": "069acc5ddee61dc2cc7c74c0a070a85715773eb91cdfc964b722671e68a9a5af",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-31_tradeoff.py": "3a57441cbe3411ed8376f8b3e46f7705a418a536ad7b76ca05f997cbd5481a39",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-01_sliding.py": "89ada96c94930b493324246a85387fa70a23e00fe91b53c43c6356d2790f318d",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-09_harder_yet.py": "9c07edd32ab2138b9abc583644bc4571073314c984fe57b35e1fd3ed7a08a5e1",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-09_new_feature_maps.py": "3015e18433f9cdf05cd43dcdbac9a38717d646503d16b0ced2a44eed41606f40",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/mqar_taylor_kv.py": "8774364410e3c738d70d7a21b5f46ca690b25ac373657f8b11f007e8bfb7533b",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_appendix/configs.py": "1cec03888000f3927e584711b221e0ebbd645459a7b5f3d291d25b57b454eaab",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_appendix/plot.py": "4b4ef9337af8354f9ee3a9f75eb569ea701c24f533aee1da1bbc50c0c30ee61b",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/README.md": "f2d6d8b5e3af9a056d02b94f5135cb0bb95abea25a09acd2d6bb16a74ce3f880",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/configs.py": "e6be1cd225bf76ab8f1135264886467b43729c8faae6bddef5874ce505693bf9",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/plot.py": "1b92399ae7d169832b469c7c31821a3bc669a7b01d46a65a7b52dfb78094fd64",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure3/configs.py": "bd1cb82c906965242c10051f36642e64345532b73624bb48ba40507a79ed92d7",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure3/plot.py": "fdb91b44e22c1b64bdd4e71f39cfa4f9bbcda6f6c8d39cd7a3beb0c3f67e80f2",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/binary_majority.py": "44edfe91ad7fae23e96d742ed909ae292687d36d1af42c5bbbf8410dd72ccce4",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/configs.py": "aef096c54b6162083cef5cd471335cf924c7863fb3d1f60f663914e755b0d45a",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/majority.py": "53a96d378a39d150be707761d720ccd2d8a52edcbf1e61e0c0bf6039d1457024",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/parity.py": "a1c87424f25610663df67fb15d08f45eb3ebf2a258a93e5c6942acf287908435",
+  "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_dmodel.py": "0aa9edd8e10324082793d9f44cc4ad14999085f640ced949bc370ebadafeabfa",
+  "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_taylor.py": "25f1be33503c182a76d1b28e0d7d56f9fdb88007e96fa66b782732ebe0c4b133",
+  "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_taylor_kv.py": "6b2970feec38354053ebbf191a82e530d3a89b5684ad4eaea17d063dbc7d6da2",
+  "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/README.md": "77152093b5357a1df7828969cf369d1cef2ef9c1273da5ca6316ae708acad0a4",
+  "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/configs.py": "c8d8dde92dd891bb5b32944a1fe65fbd1ec71819554ac81c44fe6ea265cdabbd",
+  "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/plot.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/launch.py": "bbc8b07be7c4a6c91274eba5984c2d873bb560d076d9d4cfe89b0fcadaa44c2d",
+  "upstream/zoology/logger.py": "b893d41737163e7839d01ada750dd753e2cd54021b570cf4cc647af13b052672",
+  "upstream/zoology/metrics.py": "30f7671670f456ca6c59adb54e358f85f864d1cfd7e7af3b936b6e625ddd8dfa",
+  "upstream/zoology/mixers/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/attention.py": "01a5b54afca83732b56a351000f16ec3c3d4eca0e9b4810027d27e3e79188856",
+  "upstream/zoology/mixers/base_conv.py": "ba6ef9bbb1bdff2cdc61132069ad7fe146e5abdaead6ed0b01b15ea27c2b28e8",
+  "upstream/zoology/mixers/based.py": "896010052b1932a725a19d7c70c36a80d1eb565af1953a0356ceeccf1be91cc8",
+  "upstream/zoology/mixers/bigbird.py": "02416ad0fad781c606fc3f32241132c123603fa2e886c2a53415e936bce1afd6",
+  "upstream/zoology/mixers/convolution.py": "a5b8a1b6cdf815cfe39d98c578dc3a3d80a030bf72f61644f65bab1e948cab05",
+  "upstream/zoology/mixers/deepseek/local_attention.py": "fe7a07bb2c0861388ccfba7e643cc90259ddcdc55642a4561aa7a63ca7397c34",
+  "upstream/zoology/mixers/deepseek/rotary.py": "e7036c6fbcf7d9c0114ee9b3b26401b865a6eb1ef81c08fe2d00c4281439a182",
+  "upstream/zoology/mixers/deepseek_nsa.py": "b40112585bffc416d259930a406ca499a8b699623aa21a1746fd799cf373da22",
+  "upstream/zoology/mixers/delta_net.py": "663175c6b1204c6d0aea427f628e9768e667cd90ca1652a5d75d60db90f711f1",
+  "upstream/zoology/mixers/feature_maps/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/feature_maps/all_poly.py": "bcd98450941acf6d47e999c4234bf9dd2d74276fed20a40cb13c0e28f2094c6c",
+  "upstream/zoology/mixers/feature_maps/base.py": "eee38fa9b28875792a9c5a7b82d86e3717e0c2cec79616903b469d5868154973",
+  "upstream/zoology/mixers/feature_maps/cosformer.py": "ce3816dc611599b43e5ca35eb6abe4e4763f5381e8fcb148659cc0d9580bcc44",
+  "upstream/zoology/mixers/feature_maps/exp_dim.py": "77e711e053de7d8b6970371ac913d6af6ce17a8cb7380ec9dcc30ff6fcb21de8",
+  "upstream/zoology/mixers/feature_maps/performer.py": "97be551950faec1e30f1bffddf905807233800caf3d52b6ed2b4605724a7683d",
+  "upstream/zoology/mixers/feature_maps/taylor.py": "b4cc2ba342763850915a8ee4e38476d73cf23281bcba64e4cba5eff18ad1f33c",
+  "upstream/zoology/mixers/gated_delta_net.py": "674dd32fb483ecf2ad5855aed7b9fc2fe95cd83a1937501395c828d3f3efba54",
+  "upstream/zoology/mixers/gla.py": "e29ab52a1e24264ffbd27f086ffadb24d9257e8fa66c962af6efb0ed81c4e98e",
+  "upstream/zoology/mixers/h3/__init__.py": "61baeefe5d34e8892656ebad1ccd1115894abe9dcd99b46537c609f98f969fef",
+  "upstream/zoology/mixers/h3/dplr.py": "76e764b87ae211b2e4aa1937d4187343606f34893eea77794bf58a7594feac8d",
+  "upstream/zoology/mixers/h3/h3.py": "2970534f9879e7000793f02e0a4f27cc22bd7c5b5c5610ad1b570945d007e845",
+  "upstream/zoology/mixers/h3/hippo.py": "781b41f259d91216bedf701e4747443e6aec5814af21047016013d9fd92764c8",
+  "upstream/zoology/mixers/h3/ops/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/h3/ops/fftconv.py": "b013ac4045864fbee1de82a89acccffa5438acb4fa12c1817c1a3ca1d1b3734d",
+  "upstream/zoology/mixers/h3/ops/krylov.py": "34f8b89ab034c699649cf6906a3fe52ea5d70551c87059d852d9af54e52cadbe",
+  "upstream/zoology/mixers/h3/ops/toeplitz.py": "41cbc75962d7c1d28da88856cb155b460c9471719fa632179447d482d1487124",
+  "upstream/zoology/mixers/h3/ops/vandermonde.py": "9534bfe44fb9628d1973a9253ba3ceb8858e21e366c9ee4512d705cbd1bf2163",
+  "upstream/zoology/mixers/h3/ss_kernel.py": "8d1d0db656a174b5403c0b0870c893c9ae5a2041087e47381759c1eb5b3b4b05",
+  "upstream/zoology/mixers/h3/ss_kernel_diag.py": "bc69455b99f7daeb25f382cf04e439706a9b5fba6811d610b3008d6488da6790",
+  "upstream/zoology/mixers/h3/ss_kernel_shift.py": "ccc622624c4656020d43036d7649acfbbf031b063daf132f52c28adab1e7062b",
+  "upstream/zoology/mixers/h3/ssm_utils.py": "4e2ad344fcfe1d5c6ac86a66c92f4c3935ecbb6562c7206f811095eca7eda1d8",
+  "upstream/zoology/mixers/hybrid.py": "e855a03ebaee79ad50ad342026651d4821a60cc69c674f06ebef40b98335537f",
+  "upstream/zoology/mixers/hyena.py": "e22d45babe794e873a183232ed35a0fa524f8d3af082ab4d466c78eb55c60429",
+  "upstream/zoology/mixers/listing.py": "12f227123e45ebf98215189a2e8c9f022a153317f5aa0a426c662e3bd51e8d1a",
+  "upstream/zoology/mixers/mamba.py": "0d0c250e0edac1a3f5f4a415f6e36cbc4cbe5dff416666d32e4d0c99ab727f31",
+  "upstream/zoology/mixers/mamba2.py": "9fa91391bdf70b82635d9bbee3d9455d04fdd5b741f5d10f12a6ad1eed9f813d",
+  "upstream/zoology/mixers/mamba_ssm/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/ops/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/ops/selective_scan_interface.py": "061e90aa71e2f4d783cc759d15f5896344548cc8ba66ad3050859df407026d7c",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/k_activations.py": "ffbb19486ce6f24ac7082f78915ce7cae40e1f507d39621ac964dd3c01468c26",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/layer_norm.py": "19b92346f5aa54c489fb19e6054552a0f6bb6fb8e4b3692417f0d9d83ec07144",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/layernorm.py": "a695126596345d3abadea9928550caf3eff74c13cda110cc0ca0a9596e93da97",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/layernorm_gated.py": "3a37ef83da00ec889598519e94e02438e38f7ddd29fb10ddcc423948f5fd7c35",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/selective_state_update.py": "2cad6e8464f06d504fecb2b5ac55edefc1fbdad1e2c10b345ae933d6ea8f9ca5",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/softplus.py": "1913728b87c1678922594319a8000287df4318c5420d4982dad7e427ca76bac7",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_bmm.py": "677e503a7d8950f848c0e51cf0f587bed3eb3e0a401adfb8b3eb33cd406b3c41",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_chunk_scan.py": "d67bdd87c5373bc33bf8cd255071fc10c8ed9b88ac51830a40aee11599b67a81",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_chunk_state.py": "7def68d10a9f50c7428349941effa742f8140daf99df83dc40e0db8db4efe3b9",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_combined.py": "a6f5383ac64b5db5d3f2ba68c6f3a68a7b0e4c6ea99d7b8e35ace7034dbd0e0f",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_state_passing.py": "a9ff7fca5b3d70433441a2526c5c9d88a8d26f915d16d9eb2e327aba39ae9522",
+  "upstream/zoology/mixers/mamba_ssm/selective_scan_interface.py": "eb1d25ef01bc909834a192beba616fbffc5d91bdcb4f267b52fb44035e358021",
+  "upstream/zoology/mixers/mamba_ssm/triton/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/triton/layernorm.py": "502788d223db325397969ad61166b3c56a09729acf1fd8b48b249ebc4582ed8f",
+  "upstream/zoology/mixers/mamba_ssm/triton/selective_state_update.py": "7053c88e64be5f8e2f26a776bf25ca2d85f5d506b6f112af48d87ab15a0f93a5",
+  "upstream/zoology/mixers/mlp.py": "eb03f4d04b84b8eb692bd98647e15abf1f168ae9b7953facb48693c1848b0fa6",
+  "upstream/zoology/mixers/mra/__init__.py": "f1b32ae4d6398e2f0bf125d8541a12edfbd0786632eb82865a9c04a44dde9c3b",
+  "upstream/zoology/mixers/mra/attention.py": "6ded4eeacbf1b24aea8dfcefe9d98e2af0c2b909b25cf238f3f5d7f589d43f99",
+  "upstream/zoology/mixers/mra/autograd_function.py": "b30a4d4084626e5d85fbebd00abf9c5ceb51e5f266c2b7cb5d2bfcf418a37164",
+  "upstream/zoology/mixers/mra/cuda/cuda_kernel.cu": "fad8eee8738ff59ebc00606c0cff6a100b3898288852e967f0b3e8f58672e167",
+  "upstream/zoology/mixers/mra/cuda/cuda_kernel.h": "58607c30a33c4980862edb5169c312f2327cbdbc3fd79f56f198c99525705465",
+  "upstream/zoology/mixers/mra/cuda/cuda_launch.cu": "9051d010bd80cd91a056349105b7c922468fcff06e713288b45741c5ec06e18e",
+  "upstream/zoology/mixers/mra/cuda/cuda_launch.h": "e006d7e5b11a1ff8e9ffbef67db4d5902896f2317f94662589d7bec6f488ce6b",
+  "upstream/zoology/mixers/mra/cuda/torch_extension.cpp": "6e64cac2cb7108264f15d9d961e3798b51d560c4c19a10d52c29ecfe466be331",
+  "upstream/zoology/mixers/mra/kernel.py": "27a5e962b027ae808e76f0ca1b95cf3a685d9a7b5ce3dfc9ea6b50cf0e621546",
+  "upstream/zoology/mixers/mra/mra.py": "9b9ea0deaa9c5f4be79db2c1d1f4e834a658005d02d8dd619d39a51cef4204f8",
+  "upstream/zoology/mixers/nysfromformer.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/nystromformer/__init__.py": "478954c54180640e228b722f89d7596fe174ee084737e6d6024942f1dd272ade",
+  "upstream/zoology/mixers/nystromformer/attn.py": "d55b1f8c3da6373d65f332efb0982752a0941dae01f9a368d0138cc41cc6aa91",
+  "upstream/zoology/mixers/nystromformer/attn_mask.py": "8c742f0943663b1e372ceab69fd6f0d22c046632cd501d1148015a5acdd3f73a",
+  "upstream/zoology/mixers/nystromformer/core.py": "a2767ad965e59a00dfef84c86754488d7f9f03fa38591e66f2b76668323428cb",
+  "upstream/zoology/mixers/nystromformer/nystromformer.py": "9fba6069a1aa7152ab6a8e76199ec9ccd28c6eb2f8a9fb4591d8e4428b9952b0",
+  "upstream/zoology/mixers/nystromformer/ops.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/nystromformer/utils.py": "7bd8fe104fa3c29ef6593e5095395f4a1f09c6fa080bc6daccb71ad6c07b8946",
+  "upstream/zoology/mixers/rwkv.py": "ed4e3b48aa94618006500a3e197127eaac2e8d4f0dae5ce36797c8984f75f266",
+  "upstream/zoology/mixers/rwkv/v4/wkv_cuda.cu": "1e74c2b9bc9917bf7ce55aa05b38ce5038485e7b7c787d21eb98103836a32ab4",
+  "upstream/zoology/mixers/rwkv/v4/wkv_op.cpp": "f9bcfbc615fa7d9e6623a9b91f0b802715b3814eb1c50595f41234d775f6cc10",
+  "upstream/zoology/mixers/rwkv/v5/wkv5_cuda.cu": "9b76f9bf7958cef301ff49d445ceca031a21e485fbec4453e801fbcbde6b6e45",
+  "upstream/zoology/mixers/rwkv/v5/wkv5_op.cpp": "2fc8efa6c6a50abee0849dbe6c7596483466de9d9098d42312983b2af45c8f6f",
+  "upstream/zoology/mixers/rwkv5.py": "bdbe6dd5de9274097c1c9eb52fce49ba7a75bdbac15210e21c45b67af0544116",
+  "upstream/zoology/mixers/rwkv7.py": "51fc5b7f7632a840bbd1866eb03146647b784e6e0696d8e019f0075b195d211a",
+  "upstream/zoology/mixers/scatterbrain/__init__.py": "e9ea7d53368d1e7994249c2c0fa5ca7dfa2961995dbbe11724870e0989afae19",
+  "upstream/zoology/mixers/scatterbrain/attn.py": "1676f9e02abaeda31eb65b594c4b37d20c194f08c4dc719a44937d6ea70daa63",
+  "upstream/zoology/mixers/scatterbrain/feature_maps_sb.py": "435341a1fae3ec18d28d1c59ef76fd7ddaa31e7790a731f69a2ed0614f7cdc54",
+  "upstream/zoology/mixers/scatterbrain/masking.py": "13f16706ce8cb21e3e457e9c561cca0695757b05ef83ad28a332d115dbceb37a",
+  "upstream/zoology/mixers/scatterbrain/projection_utils.py": "58361c02501e0f3947c3d978c9789f63caa65edc6c5abd35f60f0b5d95d647ba",
+  "upstream/zoology/mixers/scatterbrain/scatterbrain_utils.py": "6f836e9832ca563039bb752c50c7bc4b84bd7a03125573cc54d1340eef5ef0d5",
+  "upstream/zoology/mixers/scatterbrain_new.py": "67a3521b4607c6320b37d81d3826abd293444a6c72c8715f7a18f9fad872973c",
+  "upstream/zoology/mixers/selective.py": "cd2d58ae0ad53c2278f9437e3be871e215eb5a72d125ebf45e3ca2a5b1c99a3b",
+  "upstream/zoology/mixers/slide_attn.py": "d7af8113f3cd579c1337f306f47b7c79c820c66aff509c82572fbfbc1f3b33fb",
+  "upstream/zoology/mixers/ttt.py": "c75ff49adccee87198b0b8815fc3e264684c03c10bc46b87bb1d3ec6d1daba2a",
+  "upstream/zoology/model.py": "ec29777ff3f4ba7ac91b440a860c8769a6e9b8471a08a84d3e19a36488170fcb",
+  "upstream/zoology/train.py": "18128f75f468539ea725a4391028ea313c20b2f644530610354db930f74e4658",
+  "upstream/zoology/utils.py": "0bca95c777dfe73806895dac12efe5d0c4fda1edba19810a29866f5565891f57"
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e2_paced_v2/source_manifest_before.json

@@ -0,0 +1,188 @@
+{
+  "code/discretization_mixing/__init__.py": "55f93431b8e7bff41a44bbb79c1648a5bbdef2a93c4e9ecb4679c894f29f5d69",
+  "code/discretization_mixing/core.py": "5863bf8dca6d233a209b5a36598f59154fe50e2f544b6a503ed09eee65187c71",
+  "code/discretization_mixing/coupled.py": "802c51172f9a27d69f347424e877d2cbc24c4a0290749fd2be5aa90f425a4261",
+  "code/discretization_mixing/emission_anchor.py": "da271fda1756cea05aa0d3b7ae1eed37a2d02613b1eeab361e714ae827186085",
+  "code/discretization_mixing/gauge.py": "c964aaefe68eee5fc13a0acbea0e038e2d7f65c93314c9cdec617594598eae05",
+  "code/discretization_mixing/models.py": "104a3ad97ec72c1ecedd292c60a84bded62672b625eba2a242ba8ecb66669ec0",
+  "code/discretization_mixing/poststate_replay.py": "21ac93d5ad61a5fdc4d79db0fcb33c513786b1abc2d12f6746c2e46702e107b6",
+  "code/discretization_mixing/poststate_replay_graph.py": "4bd496200c4783c4d4c736a005724053addb9da403b7d416a690ebcdd23eb664",
+  "code/discretization_mixing/preflight.py": "a15acc29f83ff6cf6a03b58a8df802dbd3ea74038f8eda2b83b98265ae586a2b",
+  "code/discretization_mixing/retimed_models.py": "dd1bbf697626c8daa9a4a6a0273b005a8c362e2ce1f310450106eb782e0104ff",
+  "code/discretization_mixing/run.py": "1920751b7bccfca56badee1a6e3718df5a6f5f41f6b87171974e29bd88ce63a3",
+  "code/discretization_mixing/tasks.py": "46ad130e70a352c8aeae975abd55198ec0afe0835ce1e833ccc9f1a6822f6dd9",
+  "code/discretization_mixing/verify.py": "1d2242e53b6793b6782275b782f2a895dae959173483a5a465027ff283e812fd",
+  "tests/test_zoology_adapter.py": "f3888c21ab63ddeb0c1a98f801ae0d72010185dba6e10dbb9c06dedbbf675ca2",
+  "tools/__init__.py": "9798da858190f4f16d85d4d4804cde32cb73df831e509f93e2028ec75831d981",
+  "tools/benchmarks/__init__.py": "871c0f71154e97f70b97d89123e297267134e6dfc98e37f4b8fe8710f3bb4fd2",
+  "tools/benchmarks/run_zoology_mqar.py": "374cc4831dd6bdf27ae37f1915e7498cab199f3bbaef647d2dfe0f7b274b3d7e",
+  "tools/benchmarks/run_zoology_mqar_paced.py": "62a6ae9528bc75dd251567b4b26d508b0bced4e43e3cab32c4394328abb8b13b",
+  "tools/research_audit/__init__.py": "03cb7cd7d94757ca20e8ed1b151a996f5b29e5b369f25afcf1504f13e23b0317",
+  "tools/research_audit/fast_tasks.py": "80d5395e841e939c64523002dd83aba14fa41000f23f306fbabc6e446ba205c2",
+  "upstream/LICENSE.md": "9d9baa9d20e3c6094f555bcc8e1d000cd91c692709a7e99379a5886304d95eea",
+  "upstream/README.md": "f2444ed90224ac1d4091cb7e0e8f435a00d342f84cc1b989689d1f81fb37b96f",
+  "upstream/setup.py": "a0e6e928972015dbd65ff13577eb982aa9f2469e8de66ee472a941859c9813ed",
+  "upstream/usage.md": "ba24fab59fd2991a06468b7475ccbe57d7424e1a45f72ce00acd88d3c73dda7b",
+  "upstream/zoology/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/analysis/__init__.py": "995f279d1d190305f2ca7a43e090ed2e63a8be1aa16f9fe78bbc727d4baa73c1",
+  "upstream/zoology/analysis/capacity/mqar_fact_capacity.py": "6cf3e1f3a9b4cdab8f1b9d6d2ae8bc2778d396c5e4e7b9416fa954314389177c",
+  "upstream/zoology/analysis/capacity/mqar_repro_plots.py": "e9897daad0f78091939d7d988708810501594f4e6e92c406134c380e9881570a",
+  "upstream/zoology/analysis/mqar_plotting_example.py": "d59e78608231af34baa5baa02b21adec54ccf0ea406a47aaec553ed630527d32",
+  "upstream/zoology/analysis/paper/based_paper/based_figure1.py": "919dbcbc6e3098cc0f13acb0ef9ae289cf8cf8b078be9706e94d9ff59f1cf7d5",
+  "upstream/zoology/analysis/paper/based_paper/based_wall_clock.py": "192e111b3e02b28818ec4d10c89bfbb6b24c3afec635afbf7f66ee81176b4bae",
+  "upstream/zoology/analysis/paper/sabri/01-25_num_kv.py": "d1b8b113aed1fdd9bd021d40d90dd33baaae1f078ed2dcff96a24ce15479aae8",
+  "upstream/zoology/analysis/paper/sabri/01-26_tradeoff.py": "16fa0f3c39fb97d66eae6f9add72b9e78d11b30364ddc1eb8da1df183898d043",
+  "upstream/zoology/analysis/paper/sabri/01-27_traeoff.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/analysis/paper/zoology_paper/mqar_d_model.py": "be3cabc179a43c2019bb05f7a5a8dc4d35cd6c98a28af1814bdd91c184851eb7",
+  "upstream/zoology/analysis/paper/zoology_paper/mqar_taylor.py": "1762900e95d79332a00baf0180443013e780392088e740020fa9e84c5862c507",
+  "upstream/zoology/analysis/paper/zoology_paper/mqar_taylor_kv.py": "71c9fbaecbaa9a3263a14bcea92a3c3d6ab176244a3f0e20f56fbd2293420a26",
+  "upstream/zoology/analysis/paper/zoology_paper/num_kv.py": "9ffe1e9cce599fab39e116f61c36f83b5b1eb8879e0f382f0fa9e6471fe821e3",
+  "upstream/zoology/analysis/paper/zoology_paper/zoology_figure2.py": "940ccc8601f85abb4f6dd2deabcddc01d267f13f1da79660a6a8ad2c4c30eb42",
+  "upstream/zoology/analysis/utils.py": "290888694a9566fcbc519cf1d5ff42e5f295a0ceae1d079a8131704678c1d142",
+  "upstream/zoology/config.py": "6528d06a6a5f5cb167a843116a9d49cd3e9e3f7badc74c4f8a3f2a8faf4b9b91",
+  "upstream/zoology/data/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/data/ar_extrapolate.py": "4ade3204a92c3df781545b8748fca920ba137234ca2279ff3ece3ea52e00aa32",
+  "upstream/zoology/data/circuits.py": "c840251d356b429562aa042b8b0cab3be84c3c657d2511cb53ed7c1e408c3b38",
+  "upstream/zoology/data/compositional_mqar.py": "74d12d33d755c1bcce8c48cda56f179dc9c04d1b1abd509d5a1a26150329808f",
+  "upstream/zoology/data/forgetting_mqar.py": "fa20f397856b463ccc6b2fde4cf9b06a5f6256f70bd53f68be28e5a5e08d57b2",
+  "upstream/zoology/data/multiquery_ar.py": "d9d22c081a20f2da447d4d23cbde18c716e4f748b9e6236cb2d5adde796b3f29",
+  "upstream/zoology/data/stacked_mqar.py": "352b382941bd2c62cb638c6830f37454192abbc8fde59103c82b44449b5a360a",
+  "upstream/zoology/data/utils.py": "532170abcb36a086b2638e95796184e0f42612c66d4cc9bc4c34d892a5307c02",
+  "upstream/zoology/experiments/011126/mqar_continuous.py": "3c0b3241a5f20cd145b70ff5eb9b862d5f4254e773669d9427dd5508fb28fd86",
+  "upstream/zoology/experiments/011126/mqar_continuous_mse_loss.py": "32b968b1b0f4dab2c3de809e5dc0690c6353a0898c0ef27f7e2f59430470e555",
+  "upstream/zoology/experiments/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/experiments/basic_examples/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/experiments/basic_examples/basic.py": "69cbd3ec13ca98d13dc7c09799aa838a1411ced6ad8926268d241597d9befc54",
+  "upstream/zoology/experiments/basic_examples/basic_sweep.py": "f2b58f87447c487b3110e7be4d020b3eaab8c0a8e36eb80095c124e67d32e184",
+  "upstream/zoology/experiments/models_repo.py": "19e1c438fdfa88a538a78ad4edc822bc98d07642bc98092cfce6993f063217b8",
+  "upstream/zoology/experiments/mqar_example_configs/composition_configs.py": "e4d7eaf07954260edb407fe6d36d762b792f886d6017962c467a20df65f3c765",
+  "upstream/zoology/experiments/mqar_example_configs/composition_configs_random_false.py": "ee6843d320f6968563eaf708616ce8d5251b4ec699bcfcd89cf27d817c7384c8",
+  "upstream/zoology/experiments/mqar_example_configs/forgetting_configs.py": "5a1fdb058c5e7d04b5e4b6983478d428489c1291135ef3e4bad241ff3ab23629",
+  "upstream/zoology/experiments/mqar_example_configs/mqar_configs_random_false.py": "9ce23acde82665a56285ee4c98d8fbd0625e9acba34bcfda63dd291ab04f8fbc",
+  "upstream/zoology/experiments/mqar_example_configs/original_mqar_configs.py": "e599659b3b8d863de5946ec3cb037be9a7be9adf7eff73b52627e7f01db400cd",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-26_extrap.py": "412842831844afc4aca351fd58119c779a5735024626cc4c28dd6920652443d0",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-27_feature_map.py": "68d8ac3758082f132d229099fe5faad5052b579bb9c964288ffdda5e3a9c6213",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-27_tradeoff.py": "ad056f0282cb2a18f4bcb5096ce0d6f3aa351f032a9bd5b496626c369d899ef6",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-28_taylor_low.py": "069acc5ddee61dc2cc7c74c0a070a85715773eb91cdfc964b722671e68a9a5af",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-31_tradeoff.py": "3a57441cbe3411ed8376f8b3e46f7705a418a536ad7b76ca05f997cbd5481a39",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-01_sliding.py": "89ada96c94930b493324246a85387fa70a23e00fe91b53c43c6356d2790f318d",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-09_harder_yet.py": "9c07edd32ab2138b9abc583644bc4571073314c984fe57b35e1fd3ed7a08a5e1",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-09_new_feature_maps.py": "3015e18433f9cdf05cd43dcdbac9a38717d646503d16b0ced2a44eed41606f40",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/mqar_taylor_kv.py": "8774364410e3c738d70d7a21b5f46ca690b25ac373657f8b11f007e8bfb7533b",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_appendix/configs.py": "1cec03888000f3927e584711b221e0ebbd645459a7b5f3d291d25b57b454eaab",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_appendix/plot.py": "4b4ef9337af8354f9ee3a9f75eb569ea701c24f533aee1da1bbc50c0c30ee61b",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/README.md": "f2d6d8b5e3af9a056d02b94f5135cb0bb95abea25a09acd2d6bb16a74ce3f880",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/configs.py": "e6be1cd225bf76ab8f1135264886467b43729c8faae6bddef5874ce505693bf9",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/plot.py": "1b92399ae7d169832b469c7c31821a3bc669a7b01d46a65a7b52dfb78094fd64",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure3/configs.py": "bd1cb82c906965242c10051f36642e64345532b73624bb48ba40507a79ed92d7",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure3/plot.py": "fdb91b44e22c1b64bdd4e71f39cfa4f9bbcda6f6c8d39cd7a3beb0c3f67e80f2",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/binary_majority.py": "44edfe91ad7fae23e96d742ed909ae292687d36d1af42c5bbbf8410dd72ccce4",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/configs.py": "aef096c54b6162083cef5cd471335cf924c7863fb3d1f60f663914e755b0d45a",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/majority.py": "53a96d378a39d150be707761d720ccd2d8a52edcbf1e61e0c0bf6039d1457024",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/parity.py": "a1c87424f25610663df67fb15d08f45eb3ebf2a258a93e5c6942acf287908435",
+  "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_dmodel.py": "0aa9edd8e10324082793d9f44cc4ad14999085f640ced949bc370ebadafeabfa",
+  "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_taylor.py": "25f1be33503c182a76d1b28e0d7d56f9fdb88007e96fa66b782732ebe0c4b133",
+  "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_taylor_kv.py": "6b2970feec38354053ebbf191a82e530d3a89b5684ad4eaea17d063dbc7d6da2",
+  "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/README.md": "77152093b5357a1df7828969cf369d1cef2ef9c1273da5ca6316ae708acad0a4",
+  "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/configs.py": "c8d8dde92dd891bb5b32944a1fe65fbd1ec71819554ac81c44fe6ea265cdabbd",
+  "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/plot.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/launch.py": "bbc8b07be7c4a6c91274eba5984c2d873bb560d076d9d4cfe89b0fcadaa44c2d",
+  "upstream/zoology/logger.py": "b893d41737163e7839d01ada750dd753e2cd54021b570cf4cc647af13b052672",
+  "upstream/zoology/metrics.py": "30f7671670f456ca6c59adb54e358f85f864d1cfd7e7af3b936b6e625ddd8dfa",
+  "upstream/zoology/mixers/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/attention.py": "01a5b54afca83732b56a351000f16ec3c3d4eca0e9b4810027d27e3e79188856",
+  "upstream/zoology/mixers/base_conv.py": "ba6ef9bbb1bdff2cdc61132069ad7fe146e5abdaead6ed0b01b15ea27c2b28e8",
+  "upstream/zoology/mixers/based.py": "896010052b1932a725a19d7c70c36a80d1eb565af1953a0356ceeccf1be91cc8",
+  "upstream/zoology/mixers/bigbird.py": "02416ad0fad781c606fc3f32241132c123603fa2e886c2a53415e936bce1afd6",
+  "upstream/zoology/mixers/convolution.py": "a5b8a1b6cdf815cfe39d98c578dc3a3d80a030bf72f61644f65bab1e948cab05",
+  "upstream/zoology/mixers/deepseek/local_attention.py": "fe7a07bb2c0861388ccfba7e643cc90259ddcdc55642a4561aa7a63ca7397c34",
+  "upstream/zoology/mixers/deepseek/rotary.py": "e7036c6fbcf7d9c0114ee9b3b26401b865a6eb1ef81c08fe2d00c4281439a182",
+  "upstream/zoology/mixers/deepseek_nsa.py": "b40112585bffc416d259930a406ca499a8b699623aa21a1746fd799cf373da22",
+  "upstream/zoology/mixers/delta_net.py": "663175c6b1204c6d0aea427f628e9768e667cd90ca1652a5d75d60db90f711f1",
+  "upstream/zoology/mixers/feature_maps/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/feature_maps/all_poly.py": "bcd98450941acf6d47e999c4234bf9dd2d74276fed20a40cb13c0e28f2094c6c",
+  "upstream/zoology/mixers/feature_maps/base.py": "eee38fa9b28875792a9c5a7b82d86e3717e0c2cec79616903b469d5868154973",
+  "upstream/zoology/mixers/feature_maps/cosformer.py": "ce3816dc611599b43e5ca35eb6abe4e4763f5381e8fcb148659cc0d9580bcc44",
+  "upstream/zoology/mixers/feature_maps/exp_dim.py": "77e711e053de7d8b6970371ac913d6af6ce17a8cb7380ec9dcc30ff6fcb21de8",
+  "upstream/zoology/mixers/feature_maps/performer.py": "97be551950faec1e30f1bffddf905807233800caf3d52b6ed2b4605724a7683d",
+  "upstream/zoology/mixers/feature_maps/taylor.py": "b4cc2ba342763850915a8ee4e38476d73cf23281bcba64e4cba5eff18ad1f33c",
+  "upstream/zoology/mixers/gated_delta_net.py": "674dd32fb483ecf2ad5855aed7b9fc2fe95cd83a1937501395c828d3f3efba54",
+  "upstream/zoology/mixers/gla.py": "e29ab52a1e24264ffbd27f086ffadb24d9257e8fa66c962af6efb0ed81c4e98e",
+  "upstream/zoology/mixers/h3/__init__.py": "61baeefe5d34e8892656ebad1ccd1115894abe9dcd99b46537c609f98f969fef",
+  "upstream/zoology/mixers/h3/dplr.py": "76e764b87ae211b2e4aa1937d4187343606f34893eea77794bf58a7594feac8d",
+  "upstream/zoology/mixers/h3/h3.py": "2970534f9879e7000793f02e0a4f27cc22bd7c5b5c5610ad1b570945d007e845",
+  "upstream/zoology/mixers/h3/hippo.py": "781b41f259d91216bedf701e4747443e6aec5814af21047016013d9fd92764c8",
+  "upstream/zoology/mixers/h3/ops/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/h3/ops/fftconv.py": "b013ac4045864fbee1de82a89acccffa5438acb4fa12c1817c1a3ca1d1b3734d",
+  "upstream/zoology/mixers/h3/ops/krylov.py": "34f8b89ab034c699649cf6906a3fe52ea5d70551c87059d852d9af54e52cadbe",
+  "upstream/zoology/mixers/h3/ops/toeplitz.py": "41cbc75962d7c1d28da88856cb155b460c9471719fa632179447d482d1487124",
+  "upstream/zoology/mixers/h3/ops/vandermonde.py": "9534bfe44fb9628d1973a9253ba3ceb8858e21e366c9ee4512d705cbd1bf2163",
+  "upstream/zoology/mixers/h3/ss_kernel.py": "8d1d0db656a174b5403c0b0870c893c9ae5a2041087e47381759c1eb5b3b4b05",
+  "upstream/zoology/mixers/h3/ss_kernel_diag.py": "bc69455b99f7daeb25f382cf04e439706a9b5fba6811d610b3008d6488da6790",
+  "upstream/zoology/mixers/h3/ss_kernel_shift.py": "ccc622624c4656020d43036d7649acfbbf031b063daf132f52c28adab1e7062b",
+  "upstream/zoology/mixers/h3/ssm_utils.py": "4e2ad344fcfe1d5c6ac86a66c92f4c3935ecbb6562c7206f811095eca7eda1d8",
+  "upstream/zoology/mixers/hybrid.py": "e855a03ebaee79ad50ad342026651d4821a60cc69c674f06ebef40b98335537f",
+  "upstream/zoology/mixers/hyena.py": "e22d45babe794e873a183232ed35a0fa524f8d3af082ab4d466c78eb55c60429",
+  "upstream/zoology/mixers/listing.py": "12f227123e45ebf98215189a2e8c9f022a153317f5aa0a426c662e3bd51e8d1a",
+  "upstream/zoology/mixers/mamba.py": "0d0c250e0edac1a3f5f4a415f6e36cbc4cbe5dff416666d32e4d0c99ab727f31",
+  "upstream/zoology/mixers/mamba2.py": "9fa91391bdf70b82635d9bbee3d9455d04fdd5b741f5d10f12a6ad1eed9f813d",
+  "upstream/zoology/mixers/mamba_ssm/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/ops/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/ops/selective_scan_interface.py": "061e90aa71e2f4d783cc759d15f5896344548cc8ba66ad3050859df407026d7c",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/k_activations.py": "ffbb19486ce6f24ac7082f78915ce7cae40e1f507d39621ac964dd3c01468c26",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/layer_norm.py": "19b92346f5aa54c489fb19e6054552a0f6bb6fb8e4b3692417f0d9d83ec07144",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/layernorm.py": "a695126596345d3abadea9928550caf3eff74c13cda110cc0ca0a9596e93da97",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/layernorm_gated.py": "3a37ef83da00ec889598519e94e02438e38f7ddd29fb10ddcc423948f5fd7c35",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/selective_state_update.py": "2cad6e8464f06d504fecb2b5ac55edefc1fbdad1e2c10b345ae933d6ea8f9ca5",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/softplus.py": "1913728b87c1678922594319a8000287df4318c5420d4982dad7e427ca76bac7",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_bmm.py": "677e503a7d8950f848c0e51cf0f587bed3eb3e0a401adfb8b3eb33cd406b3c41",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_chunk_scan.py": "d67bdd87c5373bc33bf8cd255071fc10c8ed9b88ac51830a40aee11599b67a81",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_chunk_state.py": "7def68d10a9f50c7428349941effa742f8140daf99df83dc40e0db8db4efe3b9",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_combined.py": "a6f5383ac64b5db5d3f2ba68c6f3a68a7b0e4c6ea99d7b8e35ace7034dbd0e0f",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_state_passing.py": "a9ff7fca5b3d70433441a2526c5c9d88a8d26f915d16d9eb2e327aba39ae9522",
+  "upstream/zoology/mixers/mamba_ssm/selective_scan_interface.py": "eb1d25ef01bc909834a192beba616fbffc5d91bdcb4f267b52fb44035e358021",
+  "upstream/zoology/mixers/mamba_ssm/triton/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/triton/layernorm.py": "502788d223db325397969ad61166b3c56a09729acf1fd8b48b249ebc4582ed8f",
+  "upstream/zoology/mixers/mamba_ssm/triton/selective_state_update.py": "7053c88e64be5f8e2f26a776bf25ca2d85f5d506b6f112af48d87ab15a0f93a5",
+  "upstream/zoology/mixers/mlp.py": "eb03f4d04b84b8eb692bd98647e15abf1f168ae9b7953facb48693c1848b0fa6",
+  "upstream/zoology/mixers/mra/__init__.py": "f1b32ae4d6398e2f0bf125d8541a12edfbd0786632eb82865a9c04a44dde9c3b",
+  "upstream/zoology/mixers/mra/attention.py": "6ded4eeacbf1b24aea8dfcefe9d98e2af0c2b909b25cf238f3f5d7f589d43f99",
+  "upstream/zoology/mixers/mra/autograd_function.py": "b30a4d4084626e5d85fbebd00abf9c5ceb51e5f266c2b7cb5d2bfcf418a37164",
+  "upstream/zoology/mixers/mra/cuda/cuda_kernel.cu": "fad8eee8738ff59ebc00606c0cff6a100b3898288852e967f0b3e8f58672e167",
+  "upstream/zoology/mixers/mra/cuda/cuda_kernel.h": "58607c30a33c4980862edb5169c312f2327cbdbc3fd79f56f198c99525705465",
+  "upstream/zoology/mixers/mra/cuda/cuda_launch.cu": "9051d010bd80cd91a056349105b7c922468fcff06e713288b45741c5ec06e18e",
+  "upstream/zoology/mixers/mra/cuda/cuda_launch.h": "e006d7e5b11a1ff8e9ffbef67db4d5902896f2317f94662589d7bec6f488ce6b",
+  "upstream/zoology/mixers/mra/cuda/torch_extension.cpp": "6e64cac2cb7108264f15d9d961e3798b51d560c4c19a10d52c29ecfe466be331",
+  "upstream/zoology/mixers/mra/kernel.py": "27a5e962b027ae808e76f0ca1b95cf3a685d9a7b5ce3dfc9ea6b50cf0e621546",
+  "upstream/zoology/mixers/mra/mra.py": "9b9ea0deaa9c5f4be79db2c1d1f4e834a658005d02d8dd619d39a51cef4204f8",
+  "upstream/zoology/mixers/nysfromformer.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/nystromformer/__init__.py": "478954c54180640e228b722f89d7596fe174ee084737e6d6024942f1dd272ade",
+  "upstream/zoology/mixers/nystromformer/attn.py": "d55b1f8c3da6373d65f332efb0982752a0941dae01f9a368d0138cc41cc6aa91",
+  "upstream/zoology/mixers/nystromformer/attn_mask.py": "8c742f0943663b1e372ceab69fd6f0d22c046632cd501d1148015a5acdd3f73a",
+  "upstream/zoology/mixers/nystromformer/core.py": "a2767ad965e59a00dfef84c86754488d7f9f03fa38591e66f2b76668323428cb",
+  "upstream/zoology/mixers/nystromformer/nystromformer.py": "9fba6069a1aa7152ab6a8e76199ec9ccd28c6eb2f8a9fb4591d8e4428b9952b0",
+  "upstream/zoology/mixers/nystromformer/ops.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/nystromformer/utils.py": "7bd8fe104fa3c29ef6593e5095395f4a1f09c6fa080bc6daccb71ad6c07b8946",
+  "upstream/zoology/mixers/rwkv.py": "ed4e3b48aa94618006500a3e197127eaac2e8d4f0dae5ce36797c8984f75f266",
+  "upstream/zoology/mixers/rwkv/v4/wkv_cuda.cu": "1e74c2b9bc9917bf7ce55aa05b38ce5038485e7b7c787d21eb98103836a32ab4",
+  "upstream/zoology/mixers/rwkv/v4/wkv_op.cpp": "f9bcfbc615fa7d9e6623a9b91f0b802715b3814eb1c50595f41234d775f6cc10",
+  "upstream/zoology/mixers/rwkv/v5/wkv5_cuda.cu": "9b76f9bf7958cef301ff49d445ceca031a21e485fbec4453e801fbcbde6b6e45",
+  "upstream/zoology/mixers/rwkv/v5/wkv5_op.cpp": "2fc8efa6c6a50abee0849dbe6c7596483466de9d9098d42312983b2af45c8f6f",
+  "upstream/zoology/mixers/rwkv5.py": "bdbe6dd5de9274097c1c9eb52fce49ba7a75bdbac15210e21c45b67af0544116",
+  "upstream/zoology/mixers/rwkv7.py": "51fc5b7f7632a840bbd1866eb03146647b784e6e0696d8e019f0075b195d211a",
+  "upstream/zoology/mixers/scatterbrain/__init__.py": "e9ea7d53368d1e7994249c2c0fa5ca7dfa2961995dbbe11724870e0989afae19",
+  "upstream/zoology/mixers/scatterbrain/attn.py": "1676f9e02abaeda31eb65b594c4b37d20c194f08c4dc719a44937d6ea70daa63",
+  "upstream/zoology/mixers/scatterbrain/feature_maps_sb.py": "435341a1fae3ec18d28d1c59ef76fd7ddaa31e7790a731f69a2ed0614f7cdc54",
+  "upstream/zoology/mixers/scatterbrain/masking.py": "13f16706ce8cb21e3e457e9c561cca0695757b05ef83ad28a332d115dbceb37a",
+  "upstream/zoology/mixers/scatterbrain/projection_utils.py": "58361c02501e0f3947c3d978c9789f63caa65edc6c5abd35f60f0b5d95d647ba",
+  "upstream/zoology/mixers/scatterbrain/scatterbrain_utils.py": "6f836e9832ca563039bb752c50c7bc4b84bd7a03125573cc54d1340eef5ef0d5",
+  "upstream/zoology/mixers/scatterbrain_new.py": "67a3521b4607c6320b37d81d3826abd293444a6c72c8715f7a18f9fad872973c",
+  "upstream/zoology/mixers/selective.py": "cd2d58ae0ad53c2278f9437e3be871e215eb5a72d125ebf45e3ca2a5b1c99a3b",
+  "upstream/zoology/mixers/slide_attn.py": "d7af8113f3cd579c1337f306f47b7c79c820c66aff509c82572fbfbc1f3b33fb",
+  "upstream/zoology/mixers/ttt.py": "c75ff49adccee87198b0b8815fc3e264684c03c10bc46b87bb1d3ec6d1daba2a",
+  "upstream/zoology/model.py": "ec29777ff3f4ba7ac91b440a860c8769a6e9b8471a08a84d3e19a36488170fcb",
+  "upstream/zoology/train.py": "18128f75f468539ea725a4391028ea313c20b2f644530610354db930f74e4658",
+  "upstream/zoology/utils.py": "0bca95c777dfe73806895dac12efe5d0c4fda1edba19810a29866f5565891f57"
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e2_paced_v2/source_snapshot_minimal.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c159d170a06e75129ca08b433ed67cc2e58f16e61998d4ac3c379694288781f2
+size 72647

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e2_paced_v2/source_subset_manifest.json

@@ -0,0 +1,271 @@
+{
+  "original_snapshot_sha256": "1d70a5cbfcb041f5d44d220b60f7eb8cee18850b9b1e442b0c98d76cc7c7cfc4",
+  "published_subset_sha256": "c159d170a06e75129ca08b433ed67cc2e58f16e61998d4ac3c379694288781f2",
+  "included_exact_bytes": [
+    {
+      "path": "code/discretization_mixing/__init__.py",
+      "sha256": "55f93431b8e7bff41a44bbb79c1648a5bbdef2a93c4e9ecb4679c894f29f5d69",
+      "bytes": 83
+    },
+    {
+      "path": "code/discretization_mixing/core.py",
+      "sha256": "5863bf8dca6d233a209b5a36598f59154fe50e2f544b6a503ed09eee65187c71",
+      "bytes": 4762
+    },
+    {
+      "path": "code/discretization_mixing/coupled.py",
+      "sha256": "802c51172f9a27d69f347424e877d2cbc24c4a0290749fd2be5aa90f425a4261",
+      "bytes": 29828
+    },
+    {
+      "path": "code/discretization_mixing/emission_anchor.py",
+      "sha256": "da271fda1756cea05aa0d3b7ae1eed37a2d02613b1eeab361e714ae827186085",
+      "bytes": 32529
+    },
+    {
+      "path": "code/discretization_mixing/gauge.py",
+      "sha256": "c964aaefe68eee5fc13a0acbea0e038e2d7f65c93314c9cdec617594598eae05",
+      "bytes": 6869
+    },
+    {
+      "path": "code/discretization_mixing/models.py",
+      "sha256": "104a3ad97ec72c1ecedd292c60a84bded62672b625eba2a242ba8ecb66669ec0",
+      "bytes": 8644
+    },
+    {
+      "path": "code/discretization_mixing/poststate_replay.py",
+      "sha256": "21ac93d5ad61a5fdc4d79db0fcb33c513786b1abc2d12f6746c2e46702e107b6",
+      "bytes": 32946
+    },
+    {
+      "path": "code/discretization_mixing/poststate_replay_graph.py",
+      "sha256": "4bd496200c4783c4d4c736a005724053addb9da403b7d416a690ebcdd23eb664",
+      "bytes": 33583
+    },
+    {
+      "path": "code/discretization_mixing/preflight.py",
+      "sha256": "a15acc29f83ff6cf6a03b58a8df802dbd3ea74038f8eda2b83b98265ae586a2b",
+      "bytes": 2697
+    },
+    {
+      "path": "code/discretization_mixing/retimed_models.py",
+      "sha256": "dd1bbf697626c8daa9a4a6a0273b005a8c362e2ce1f310450106eb782e0104ff",
+      "bytes": 23950
+    },
+    {
+      "path": "code/discretization_mixing/run.py",
+      "sha256": "1920751b7bccfca56badee1a6e3718df5a6f5f41f6b87171974e29bd88ce63a3",
+      "bytes": 10731
+    },
+    {
+      "path": "code/discretization_mixing/tasks.py",
+      "sha256": "46ad130e70a352c8aeae975abd55198ec0afe0835ce1e833ccc9f1a6822f6dd9",
+      "bytes": 3260
+    },
+    {
+      "path": "code/discretization_mixing/verify.py",
+      "sha256": "1d2242e53b6793b6782275b782f2a895dae959173483a5a465027ff283e812fd",
+      "bytes": 4417
+    },
+    {
+      "path": "tools/__init__.py",
+      "sha256": "9798da858190f4f16d85d4d4804cde32cb73df831e509f93e2028ec75831d981",
+      "bytes": 36
+    },
+    {
+      "path": "tools/benchmarks/__init__.py",
+      "sha256": "871c0f71154e97f70b97d89123e297267134e6dfc98e37f4b8fe8710f3bb4fd2",
+      "bytes": 75
+    },
+    {
+      "path": "tools/benchmarks/run_zoology_mqar.py",
+      "sha256": "374cc4831dd6bdf27ae37f1915e7498cab199f3bbaef647d2dfe0f7b274b3d7e",
+      "bytes": 34081
+    },
+    {
+      "path": "tools/benchmarks/run_zoology_mqar_paced.py",
+      "sha256": "62a6ae9528bc75dd251567b4b26d508b0bced4e43e3cab32c4394328abb8b13b",
+      "bytes": 1969
+    },
+    {
+      "path": "tools/research_audit/__init__.py",
+      "sha256": "03cb7cd7d94757ca20e8ed1b151a996f5b29e5b369f25afcf1504f13e23b0317",
+      "bytes": 69
+    },
+    {
+      "path": "tools/research_audit/fast_tasks.py",
+      "sha256": "80d5395e841e939c64523002dd83aba14fa41000f23f306fbabc6e446ba205c2",
+      "bytes": 13280
+    }
+  ],
+  "omitted_paths": [
+    "tests/test_zoology_adapter.py",
+    "upstream/LICENSE.md",
+    "upstream/README.md",
+    "upstream/setup.py",
+    "upstream/usage.md",
+    "upstream/zoology/__init__.py",
+    "upstream/zoology/analysis/__init__.py",
+    "upstream/zoology/analysis/capacity/mqar_fact_capacity.py",
+    "upstream/zoology/analysis/capacity/mqar_repro_plots.py",
+    "upstream/zoology/analysis/mqar_plotting_example.py",
+    "upstream/zoology/analysis/paper/based_paper/based_figure1.py",
+    "upstream/zoology/analysis/paper/based_paper/based_wall_clock.py",
+    "upstream/zoology/analysis/paper/sabri/01-25_num_kv.py",
+    "upstream/zoology/analysis/paper/sabri/01-26_tradeoff.py",
+    "upstream/zoology/analysis/paper/sabri/01-27_traeoff.py",
+    "upstream/zoology/analysis/paper/zoology_paper/mqar_d_model.py",
+    "upstream/zoology/analysis/paper/zoology_paper/mqar_taylor.py",
+    "upstream/zoology/analysis/paper/zoology_paper/mqar_taylor_kv.py",
+    "upstream/zoology/analysis/paper/zoology_paper/num_kv.py",
+    "upstream/zoology/analysis/paper/zoology_paper/zoology_figure2.py",
+    "upstream/zoology/analysis/utils.py",
+    "upstream/zoology/config.py",
+    "upstream/zoology/data/__init__.py",
+    "upstream/zoology/data/ar_extrapolate.py",
+    "upstream/zoology/data/circuits.py",
+    "upstream/zoology/data/compositional_mqar.py",
+    "upstream/zoology/data/forgetting_mqar.py",
+    "upstream/zoology/data/multiquery_ar.py",
+    "upstream/zoology/data/stacked_mqar.py",
+    "upstream/zoology/data/utils.py",
+    "upstream/zoology/experiments/011126/mqar_continuous.py",
+    "upstream/zoology/experiments/011126/mqar_continuous_mse_loss.py",
+    "upstream/zoology/experiments/__init__.py",
+    "upstream/zoology/experiments/basic_examples/__init__.py",
+    "upstream/zoology/experiments/basic_examples/basic.py",
+    "upstream/zoology/experiments/basic_examples/basic_sweep.py",
+    "upstream/zoology/experiments/models_repo.py",
+    "upstream/zoology/experiments/mqar_example_configs/composition_configs.py",
+    "upstream/zoology/experiments/mqar_example_configs/composition_configs_random_false.py",
+    "upstream/zoology/experiments/mqar_example_configs/forgetting_configs.py",
+    "upstream/zoology/experiments/mqar_example_configs/mqar_configs_random_false.py",
+    "upstream/zoology/experiments/mqar_example_configs/original_mqar_configs.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-26_extrap.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-27_feature_map.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-27_tradeoff.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-28_taylor_low.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-31_tradeoff.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-01_sliding.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-09_harder_yet.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-09_new_feature_maps.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/__init__.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/mqar_taylor_kv.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_appendix/configs.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_appendix/plot.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/README.md",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/configs.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/plot.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_figure3/configs.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_figure3/plot.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/binary_majority.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/configs.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/majority.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/parity.py",
+    "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_dmodel.py",
+    "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_taylor.py",
+    "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_taylor_kv.py",
+    "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/README.md",
+    "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/configs.py",
+    "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/plot.py",
+    "upstream/zoology/launch.py",
+    "upstream/zoology/logger.py",
+    "upstream/zoology/metrics.py",
+    "upstream/zoology/mixers/__init__.py",
+    "upstream/zoology/mixers/attention.py",
+    "upstream/zoology/mixers/base_conv.py",
+    "upstream/zoology/mixers/based.py",
+    "upstream/zoology/mixers/bigbird.py",
+    "upstream/zoology/mixers/convolution.py",
+    "upstream/zoology/mixers/deepseek/local_attention.py",
+    "upstream/zoology/mixers/deepseek/rotary.py",
+    "upstream/zoology/mixers/deepseek_nsa.py",
+    "upstream/zoology/mixers/delta_net.py",
+    "upstream/zoology/mixers/feature_maps/__init__.py",
+    "upstream/zoology/mixers/feature_maps/all_poly.py",
+    "upstream/zoology/mixers/feature_maps/base.py",
+    "upstream/zoology/mixers/feature_maps/cosformer.py",
+    "upstream/zoology/mixers/feature_maps/exp_dim.py",
+    "upstream/zoology/mixers/feature_maps/performer.py",
+    "upstream/zoology/mixers/feature_maps/taylor.py",
+    "upstream/zoology/mixers/gated_delta_net.py",
+    "upstream/zoology/mixers/gla.py",
+    "upstream/zoology/mixers/h3/__init__.py",
+    "upstream/zoology/mixers/h3/dplr.py",
+    "upstream/zoology/mixers/h3/h3.py",
+    "upstream/zoology/mixers/h3/hippo.py",
+    "upstream/zoology/mixers/h3/ops/__init__.py",
+    "upstream/zoology/mixers/h3/ops/fftconv.py",
+    "upstream/zoology/mixers/h3/ops/krylov.py",
+    "upstream/zoology/mixers/h3/ops/toeplitz.py",
+    "upstream/zoology/mixers/h3/ops/vandermonde.py",
+    "upstream/zoology/mixers/h3/ss_kernel.py",
+    "upstream/zoology/mixers/h3/ss_kernel_diag.py",
+    "upstream/zoology/mixers/h3/ss_kernel_shift.py",
+    "upstream/zoology/mixers/h3/ssm_utils.py",
+    "upstream/zoology/mixers/hybrid.py",
+    "upstream/zoology/mixers/hyena.py",
+    "upstream/zoology/mixers/listing.py",
+    "upstream/zoology/mixers/mamba.py",
+    "upstream/zoology/mixers/mamba2.py",
+    "upstream/zoology/mixers/mamba_ssm/__init__.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/__init__.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/selective_scan_interface.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/__init__.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/k_activations.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/layer_norm.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/layernorm.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/layernorm_gated.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/selective_state_update.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/softplus.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_bmm.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_chunk_scan.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_chunk_state.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_combined.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_state_passing.py",
+    "upstream/zoology/mixers/mamba_ssm/selective_scan_interface.py",
+    "upstream/zoology/mixers/mamba_ssm/triton/__init__.py",
+    "upstream/zoology/mixers/mamba_ssm/triton/layernorm.py",
+    "upstream/zoology/mixers/mamba_ssm/triton/selective_state_update.py",
+    "upstream/zoology/mixers/mlp.py",
+    "upstream/zoology/mixers/mra/__init__.py",
+    "upstream/zoology/mixers/mra/attention.py",
+    "upstream/zoology/mixers/mra/autograd_function.py",
+    "upstream/zoology/mixers/mra/cuda/cuda_kernel.cu",
+    "upstream/zoology/mixers/mra/cuda/cuda_kernel.h",
+    "upstream/zoology/mixers/mra/cuda/cuda_launch.cu",
+    "upstream/zoology/mixers/mra/cuda/cuda_launch.h",
+    "upstream/zoology/mixers/mra/cuda/torch_extension.cpp",
+    "upstream/zoology/mixers/mra/kernel.py",
+    "upstream/zoology/mixers/mra/mra.py",
+    "upstream/zoology/mixers/nysfromformer.py",
+    "upstream/zoology/mixers/nystromformer/__init__.py",
+    "upstream/zoology/mixers/nystromformer/attn.py",
+    "upstream/zoology/mixers/nystromformer/attn_mask.py",
+    "upstream/zoology/mixers/nystromformer/core.py",
+    "upstream/zoology/mixers/nystromformer/nystromformer.py",
+    "upstream/zoology/mixers/nystromformer/ops.py",
+    "upstream/zoology/mixers/nystromformer/utils.py",
+    "upstream/zoology/mixers/rwkv.py",
+    "upstream/zoology/mixers/rwkv/v4/wkv_cuda.cu",
+    "upstream/zoology/mixers/rwkv/v4/wkv_op.cpp",
+    "upstream/zoology/mixers/rwkv/v5/wkv5_cuda.cu",
+    "upstream/zoology/mixers/rwkv/v5/wkv5_op.cpp",
+    "upstream/zoology/mixers/rwkv5.py",
+    "upstream/zoology/mixers/rwkv7.py",
+    "upstream/zoology/mixers/scatterbrain/__init__.py",
+    "upstream/zoology/mixers/scatterbrain/attn.py",
+    "upstream/zoology/mixers/scatterbrain/feature_maps_sb.py",
+    "upstream/zoology/mixers/scatterbrain/masking.py",
+    "upstream/zoology/mixers/scatterbrain/projection_utils.py",
+    "upstream/zoology/mixers/scatterbrain/scatterbrain_utils.py",
+    "upstream/zoology/mixers/scatterbrain_new.py",
+    "upstream/zoology/mixers/selective.py",
+    "upstream/zoology/mixers/slide_attn.py",
+    "upstream/zoology/mixers/ttt.py",
+    "upstream/zoology/model.py",
+    "upstream/zoology/train.py",
+    "upstream/zoology/utils.py"
+  ],
+  "scope": "Project source and attributed Apache SISO subset only; upstream/vendor trees omitted. The original complete ZIP is retained locally, NOT redistributed or silently replaced."
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e2_paced_v2/status_completed.json

@@ -0,0 +1,4 @@
+{
+  "scope": "one_official_ICLR24_Figure2_data_training_cell",
+  "status": "completed"
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e2_paced_v2/status_started.json

@@ -0,0 +1,30 @@
+{
+  "args": {
+    "allow_full": true,
+    "architecture": "project_endpoint",
+    "batch_delay_seconds": 0.1,
+    "chunk": 32,
+    "cpu_threads": 4,
+    "data_seed": 123,
+    "device": "cuda",
+    "heads": 4,
+    "implementation": "stable",
+    "lr": 0.01,
+    "native_failure_artifact": "results\\benchmark_setup_20261002\\windows_native_seed_failure.json",
+    "output_dir": "results\\zoology_mqar\\v100_full_iclr24_L64_P4_endpoint_s11_lr1e2_paced_v2",
+    "profile": "full",
+    "seed": 11,
+    "seq_len": 64,
+    "state_size": 16,
+    "upstream": "<workspace>\\.cache\\upstream\\zoology",
+    "width": 64
+  },
+  "status": "started",
+  "time_utc": "2026-10-02T09:02:30.756689+00:00",
+  "upstream": {
+    "clean": true,
+    "commit": "1ad20d193b6113cae1e8f3c655c300d7b4b3f4bb",
+    "path": "<workspace>\\.cache\\upstream\\zoology",
+    "status": ""
+  }
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e4_v1/checkpoint_final.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5579e1de6eedc38224207f2b9e8bbeb655f0a060497c5b48e0274323edf33558
+size 13617805

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e4_v1/data_generation_provenance.json

@@ -0,0 +1,47 @@
+{
+  "actual_split_seeds": {
+    "test": [
+      3062119789
+    ],
+    "train": [
+      843828734
+    ]
+  },
+  "concurrency": "No concurrent data generation in this process",
+  "deviation": "Only prepare_data scope: absent np.random.randint dtype becomes np.int64; explicit dtype preserved",
+  "expected_randomstate_int64_split_seeds": {
+    "test": [
+      3062119789
+    ],
+    "train": [
+      843828734
+    ]
+  },
+  "preserved_native_failure": {
+    "path": "<workspace>\\results\\benchmark_setup_20261002\\windows_native_seed_failure.json",
+    "sha256": "f9f84844b043c27d9c0ada21cb6ed3410a927ad5fa1a6794b32c35ee468a832c"
+  },
+  "reason": "Windows default int32 rejects upstream test seed high=2**32",
+  "rng_api_restored": true,
+  "seed_draws": [
+    {
+      "dtype": "int64",
+      "high": 2147483648,
+      "low": 0,
+      "values": [
+        843828734
+      ]
+    },
+    {
+      "dtype": "int64",
+      "high": 4294967296,
+      "low": 2147483648,
+      "values": [
+        3062119789
+      ]
+    }
+  ],
+  "torch_random_nonquery_policy": "Original upstream torch.randint, no patch",
+  "vendor_source_modified": false,
+  "windows_compatibility_active": true
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e4_v1/dataset_manifest.json

@@ -0,0 +1,34 @@
+{
+  "test": [
+    {
+      "inputs_sha256": "6dc295fac235e050fe7de3dc95344ac8b6057198db94d1da352f0fb910815ac5",
+      "labels_sha256": "4dd213f03b52fdde7a4f14051c1d131ae48bf6d3cfdc70f1127c9ab035ee3690",
+      "segment": 0,
+      "shape": [
+        3000,
+        64
+      ],
+      "slices": {
+        "input_seq_len": 64,
+        "num_kv_pairs": 4,
+        "num_passes": 1
+      }
+    }
+  ],
+  "train": [
+    {
+      "inputs_sha256": "e2ea685b00cd20110aa6fb97b0f8eaaa9b260b64c3c1176a017033cbf5d192a1",
+      "labels_sha256": "1bd7f13dcf6a7cbe73c21759801720c54b630e2e90d31f76fb6addecc0844691",
+      "segment": 0,
+      "shape": [
+        100000,
+        64
+      ],
+      "slices": {
+        "input_seq_len": 64,
+        "num_kv_pairs": 4,
+        "num_passes": 1
+      }
+    }
+  ]
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e4_v1/effective_config.json

@@ -0,0 +1,159 @@
+{
+  "actual_data": {
+    "batch_size": 512,
+    "cache_dir": null,
+    "num_passes": 1,
+    "seed": 123,
+    "test_segments": [
+      {
+        "include_slices": true,
+        "input_seq_len": 64,
+        "name": "multiquery_ar",
+        "num_examples": 3000,
+        "num_kv_pairs": 4,
+        "power_a": 0.01,
+        "random_non_queries": false,
+        "vocab_size": 8192
+      }
+    ],
+    "train_segments": [
+      {
+        "include_slices": true,
+        "input_seq_len": 64,
+        "name": "multiquery_ar",
+        "num_examples": 100000,
+        "num_kv_pairs": 4,
+        "power_a": 0.01,
+        "random_non_queries": false,
+        "vocab_size": 8192
+      }
+    ]
+  },
+  "actual_model": {
+    "architecture": "project_endpoint",
+    "bc_bias": true,
+    "chunk": 32,
+    "heads": 4,
+    "implementation": "stable",
+    "layers": 2,
+    "official_mamba": false,
+    "parameter_counts": {
+      "active_trainable": 1099552,
+      "bank_total": 1100072,
+      "caution": "Shared initialization is exact; active parameter counts are not identical.",
+      "inactive_modules": [
+        "current_proj"
+      ]
+    },
+    "skip_source": "legacy",
+    "state_size": 16,
+    "values": 8192,
+    "vocab": 8192,
+    "width": 64
+  },
+  "comparison_scope": "project SSM arms are not official Mamba/Mamba-3",
+  "data_compatibility_policy": "Official prepare_data with scoped Windows default-int64 randint bridge",
+  "epoch_checkpoint_policy": "Finite flushed validation logger callback, before earlystop/scheduler.step; recovery only, not certified exact resume",
+  "initialization_bank": {
+    "equal": true,
+    "rng_state_sha256": "0efb7d38556dccd703b9e84e9501729e409f0a7d4604081bedd991a65756862e",
+    "state_sha256": {
+      "project_endpoint": "82555db6e36c97a581c8a6880b023888a01b6ff75e9a3212d2f36cd5584e346e",
+      "project_retimed": "82555db6e36c97a581c8a6880b023888a01b6ff75e9a3212d2f36cd5584e346e"
+    }
+  },
+  "label_policy": "original token IDs, full vocabulary CE, ignore_index=-100",
+  "model_config_scope": "TrainConfig.model is metadata; actual_model is authoritative for project arms",
+  "observability_guards": "Full-logit finite hook, nonfinite-metric stop, final parameter/optimizer finite audit; no optimizer changes",
+  "profile": {
+    "lr_grid": [
+      0.0001,
+      0.00046415888336127773,
+      0.002154434690031882,
+      0.01
+    ],
+    "max_epochs": 64,
+    "operational_override": {
+      "cache_dir": null
+    },
+    "requested_factory_kwargs": {
+      "num_kv_pairs": 4,
+      "random_non_queries": false,
+      "test_power_a": 0.01,
+      "train_power_a": 0.01
+    },
+    "scope": "one_official_ICLR24_Figure2_data_training_cell",
+    "selected_cell": [
+      64,
+      4
+    ],
+    "source": "zoology/experiments/paper_configs/iclr24_zoology_figure2/configs.py"
+  },
+  "train_config": {
+    "data": {
+      "batch_size": 512,
+      "cache_dir": null,
+      "force_cache": false,
+      "num_passes": 1,
+      "seed": 123,
+      "test_configs": [
+        {
+          "input_seq_len": 64,
+          "num_examples": 3000,
+          "vocab_size": 8192
+        }
+      ],
+      "train_configs": [
+        {
+          "input_seq_len": 64,
+          "num_examples": 100000,
+          "vocab_size": 8192
+        }
+      ]
+    },
+    "early_stopping_metric": "valid/accuracy",
+    "early_stopping_threshold": 0.99,
+    "input_type": "discrete",
+    "launch_id": null,
+    "learning_rate": 0.0001,
+    "logger": {
+      "entity": null,
+      "project_name": null
+    },
+    "loss_type": "ce",
+    "max_epochs": 64,
+    "model": {
+      "block_type": "TransformerBlock",
+      "d_model": 64,
+      "drop_path": 0.0,
+      "embed_dropout": 0.1,
+      "embedding_init_type": "default",
+      "layer_norm_epsilon": 1e-05,
+      "learnable_word_embeddings": true,
+      "max_position_embeddings": 64,
+      "multiplier": 1,
+      "n_layers": 2,
+      "name": "project_endpoint",
+      "pad_vocab_size_multiple": 1,
+      "resid_dropout": 0.0,
+      "sequence_mixer": {
+        "kwargs": {
+          "dropout": 0.1,
+          "num_heads": 1
+        },
+        "name": "zoology.mixers.attention.MHA"
+      },
+      "state_mixer": {
+        "kwargs": {},
+        "name": "torch.nn.Identity"
+      },
+      "vocab_size": 8192
+    },
+    "run_id": "project_endpoint",
+    "seed": 11,
+    "slice_keys": [],
+    "sweep_id": null,
+    "weight_decay": 0.1
+  },
+  "training_policy": "unchanged upstream Trainer.fit/compute_loss/test/compute_metrics"
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e4_v1/environment_after.json

@@ -0,0 +1,61 @@
+{
+  "default_dtype": "torch.float32",
+  "device_requested": "cuda",
+  "executable": "<workspace>\\.venv-v100\\Scripts\\python.exe",
+  "gpu_name": "Tesla V100-SXM2-16GB",
+  "gpu_properties": "_CudaDeviceProperties(name='Tesla V100-SXM2-16GB', major=7, minor=0, total_memory=16242MB, multi_processor_count=80, uuid=d13b7041-55e8-4532-2fb1-f4bd3f80c13f, pci_bus_id=40, pci_device_id=0, pci_domain_id=0, L2_cache_size=6MB)",
+  "num_threads": 4,
+  "packages": {
+    "GitPython": "3.2.0",
+    "Jinja2": "3.1.6",
+    "MarkupSafe": "3.0.3",
+    "PyYAML": "6.0.3",
+    "Pygments": "2.21.0",
+    "annotated-types": "0.8.0",
+    "certifi": "2026.7.22",
+    "charset-normalizer": "3.5.2",
+    "click": "8.5.0",
+    "colorama": "0.4.6",
+    "einops": "0.8.1",
+    "filelock": "4.0.9",
+    "fsspec": "2026.9.0",
+    "gitdb": "4.0.12",
+    "idna": "3.20",
+    "iniconfig": "2.3.0",
+    "mpmath": "1.3.0",
+    "networkx": "3.7",
+    "numpy": "2.2.6",
+    "packaging": "26.3",
+    "pandas": "2.3.3",
+    "pillow": "11.3.0",
+    "pip": "25.0.1",
+    "platformdirs": "4.12.2",
+    "pluggy": "1.6.0",
+    "protobuf": "6.33.6",
+    "pydantic": "2.11.7",
+    "pydantic_core": "2.33.2",
+    "pytest": "8.4.1",
+    "python-dateutil": "2.9.0.post0",
+    "pytz": "2026.4",
+    "requests": "2.34.2",
+    "sentry-sdk": "2.71.0",
+    "setuptools": "84.0.0",
+    "six": "1.17.0",
+    "smmap": "5.0.3",
+    "sympy": "1.14.0",
+    "torch": "2.9.1+cu126",
+    "torchvision": "0.24.1+cu126",
+    "tqdm": "4.67.1",
+    "typing-inspection": "0.4.4",
+    "typing_extensions": "4.16.0",
+    "tzdata": "2026.4",
+    "urllib3": "2.8.0",
+    "wandb": "0.23.0"
+  },
+  "platform": "Windows-11-10.0.26200-SP0",
+  "python": "3.13.3 (tags/v3.13.3:6280bb5, Apr  8 2025, 14:47:33) [MSC v.1943 64 bit (AMD64)]",
+  "torch": "2.9.1+cu126",
+  "torch_cuda": "12.6",
+  "wandb_disabled": "true",
+  "wandb_mode": "disabled"
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e4_v1/environment_before.json

@@ -0,0 +1,61 @@
+{
+  "default_dtype": "torch.float32",
+  "device_requested": "cuda",
+  "executable": "<workspace>\\.venv-v100\\Scripts\\python.exe",
+  "gpu_name": "Tesla V100-SXM2-16GB",
+  "gpu_properties": "_CudaDeviceProperties(name='Tesla V100-SXM2-16GB', major=7, minor=0, total_memory=16242MB, multi_processor_count=80, uuid=d13b7041-55e8-4532-2fb1-f4bd3f80c13f, pci_bus_id=40, pci_device_id=0, pci_domain_id=0, L2_cache_size=6MB)",
+  "num_threads": 4,
+  "packages": {
+    "GitPython": "3.2.0",
+    "Jinja2": "3.1.6",
+    "MarkupSafe": "3.0.3",
+    "PyYAML": "6.0.3",
+    "Pygments": "2.21.0",
+    "annotated-types": "0.8.0",
+    "certifi": "2026.7.22",
+    "charset-normalizer": "3.5.2",
+    "click": "8.5.0",
+    "colorama": "0.4.6",
+    "einops": "0.8.1",
+    "filelock": "4.0.9",
+    "fsspec": "2026.9.0",
+    "gitdb": "4.0.12",
+    "idna": "3.20",
+    "iniconfig": "2.3.0",
+    "mpmath": "1.3.0",
+    "networkx": "3.7",
+    "numpy": "2.2.6",
+    "packaging": "26.3",
+    "pandas": "2.3.3",
+    "pillow": "11.3.0",
+    "pip": "25.0.1",
+    "platformdirs": "4.12.2",
+    "pluggy": "1.6.0",
+    "protobuf": "6.33.6",
+    "pydantic": "2.11.7",
+    "pydantic_core": "2.33.2",
+    "pytest": "8.4.1",
+    "python-dateutil": "2.9.0.post0",
+    "pytz": "2026.4",
+    "requests": "2.34.2",
+    "sentry-sdk": "2.71.0",
+    "setuptools": "84.0.0",
+    "six": "1.17.0",
+    "smmap": "5.0.3",
+    "sympy": "1.14.0",
+    "torch": "2.9.1+cu126",
+    "torchvision": "0.24.1+cu126",
+    "tqdm": "4.67.1",
+    "typing-inspection": "0.4.4",
+    "typing_extensions": "4.16.0",
+    "tzdata": "2026.4",
+    "urllib3": "2.8.0",
+    "wandb": "0.23.0"
+  },
+  "platform": "Windows-11-10.0.26200-SP0",
+  "python": "3.13.3 (tags/v3.13.3:6280bb5, Apr  8 2025, 14:47:33) [MSC v.1943 64 bit (AMD64)]",
+  "torch": "2.9.1+cu126",
+  "torch_cuda": "12.6",
+  "wandb_disabled": "true",
+  "wandb_mode": "disabled"
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e4_v1/execution_provenance.json

@@ -0,0 +1,34 @@
+{
+  "imported_modules": {
+    "discretization_mixing": "<workspace>\\code\\discretization_mixing\\__init__.py",
+    "discretization_mixing.core": "<workspace>\\code\\discretization_mixing\\core.py",
+    "discretization_mixing.coupled": "<workspace>\\code\\discretization_mixing\\coupled.py",
+    "discretization_mixing.gauge": "<workspace>\\code\\discretization_mixing\\gauge.py",
+    "discretization_mixing.models": "<workspace>\\code\\discretization_mixing\\models.py",
+    "discretization_mixing.retimed_models": "<workspace>\\code\\discretization_mixing\\retimed_models.py",
+    "zoology": "<workspace>\\.cache\\upstream\\zoology\\zoology\\__init__.py",
+    "zoology.config": "<workspace>\\.cache\\upstream\\zoology\\zoology\\config.py",
+    "zoology.data": "<workspace>\\.cache\\upstream\\zoology\\zoology\\data\\__init__.py",
+    "zoology.data.multiquery_ar": "<workspace>\\.cache\\upstream\\zoology\\zoology\\data\\multiquery_ar.py",
+    "zoology.data.utils": "<workspace>\\.cache\\upstream\\zoology\\zoology\\data\\utils.py",
+    "zoology.logger": "<workspace>\\.cache\\upstream\\zoology\\zoology\\logger.py",
+    "zoology.metrics": "<workspace>\\.cache\\upstream\\zoology\\zoology\\metrics.py",
+    "zoology.model": "<workspace>\\.cache\\upstream\\zoology\\zoology\\model.py",
+    "zoology.train": "<workspace>\\.cache\\upstream\\zoology\\zoology\\train.py",
+    "zoology.utils": "<workspace>\\.cache\\upstream\\zoology\\zoology\\utils.py"
+  },
+  "source_snapshot_sha256": "fe1cbc796ccdb79351cab3f8e4e323740877c87051b4cc745950311449d9425d",
+  "source_stable": true,
+  "upstream_after": {
+    "clean": true,
+    "commit": "1ad20d193b6113cae1e8f3c655c300d7b4b3f4bb",
+    "path": "<workspace>\\.cache\\upstream\\zoology",
+    "status": ""
+  },
+  "upstream_before": {
+    "clean": true,
+    "commit": "1ad20d193b6113cae1e8f3c655c300d7b4b3f4bb",
+    "path": "<workspace>\\.cache\\upstream\\zoology",
+    "status": ""
+  }
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e4_v1/final_summary.json

@@ -0,0 +1,11 @@
+{
+  "accuracy": 0.043583333333333335,
+  "architecture": "project_endpoint",
+  "last_upstream_validation": {
+    "epoch": 63,
+    "valid/accuracy": 0.043583333333333335,
+    "valid/loss": 7.81258487701416
+  },
+  "scope": "one_official_ICLR24_Figure2_data_training_cell",
+  "sequences": 3000
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e4_v1/finite_audit.json

@@ -0,0 +1,11 @@
+{
+  "final_state": {
+    "finite": true,
+    "nonfinite_paths": [],
+    "tensor_count": 152
+  },
+  "outputs": {
+    "forward_calls": 12934,
+    "full_logits_finite": true
+  }
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e4_v1/source_manifest_after.json

@@ -0,0 +1,187 @@
+{
+  "code/discretization_mixing/__init__.py": "55f93431b8e7bff41a44bbb79c1648a5bbdef2a93c4e9ecb4679c894f29f5d69",
+  "code/discretization_mixing/core.py": "5863bf8dca6d233a209b5a36598f59154fe50e2f544b6a503ed09eee65187c71",
+  "code/discretization_mixing/coupled.py": "802c51172f9a27d69f347424e877d2cbc24c4a0290749fd2be5aa90f425a4261",
+  "code/discretization_mixing/emission_anchor.py": "da271fda1756cea05aa0d3b7ae1eed37a2d02613b1eeab361e714ae827186085",
+  "code/discretization_mixing/gauge.py": "c964aaefe68eee5fc13a0acbea0e038e2d7f65c93314c9cdec617594598eae05",
+  "code/discretization_mixing/models.py": "104a3ad97ec72c1ecedd292c60a84bded62672b625eba2a242ba8ecb66669ec0",
+  "code/discretization_mixing/poststate_replay.py": "21ac93d5ad61a5fdc4d79db0fcb33c513786b1abc2d12f6746c2e46702e107b6",
+  "code/discretization_mixing/poststate_replay_graph.py": "4bd496200c4783c4d4c736a005724053addb9da403b7d416a690ebcdd23eb664",
+  "code/discretization_mixing/preflight.py": "a15acc29f83ff6cf6a03b58a8df802dbd3ea74038f8eda2b83b98265ae586a2b",
+  "code/discretization_mixing/retimed_models.py": "dd1bbf697626c8daa9a4a6a0273b005a8c362e2ce1f310450106eb782e0104ff",
+  "code/discretization_mixing/run.py": "1920751b7bccfca56badee1a6e3718df5a6f5f41f6b87171974e29bd88ce63a3",
+  "code/discretization_mixing/tasks.py": "46ad130e70a352c8aeae975abd55198ec0afe0835ce1e833ccc9f1a6822f6dd9",
+  "code/discretization_mixing/verify.py": "1d2242e53b6793b6782275b782f2a895dae959173483a5a465027ff283e812fd",
+  "tests/test_zoology_adapter.py": "f3888c21ab63ddeb0c1a98f801ae0d72010185dba6e10dbb9c06dedbbf675ca2",
+  "tools/__init__.py": "9798da858190f4f16d85d4d4804cde32cb73df831e509f93e2028ec75831d981",
+  "tools/benchmarks/__init__.py": "871c0f71154e97f70b97d89123e297267134e6dfc98e37f4b8fe8710f3bb4fd2",
+  "tools/benchmarks/run_zoology_mqar.py": "374cc4831dd6bdf27ae37f1915e7498cab199f3bbaef647d2dfe0f7b274b3d7e",
+  "tools/research_audit/__init__.py": "03cb7cd7d94757ca20e8ed1b151a996f5b29e5b369f25afcf1504f13e23b0317",
+  "tools/research_audit/fast_tasks.py": "80d5395e841e939c64523002dd83aba14fa41000f23f306fbabc6e446ba205c2",
+  "upstream/LICENSE.md": "9d9baa9d20e3c6094f555bcc8e1d000cd91c692709a7e99379a5886304d95eea",
+  "upstream/README.md": "f2444ed90224ac1d4091cb7e0e8f435a00d342f84cc1b989689d1f81fb37b96f",
+  "upstream/setup.py": "a0e6e928972015dbd65ff13577eb982aa9f2469e8de66ee472a941859c9813ed",
+  "upstream/usage.md": "ba24fab59fd2991a06468b7475ccbe57d7424e1a45f72ce00acd88d3c73dda7b",
+  "upstream/zoology/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/analysis/__init__.py": "995f279d1d190305f2ca7a43e090ed2e63a8be1aa16f9fe78bbc727d4baa73c1",
+  "upstream/zoology/analysis/capacity/mqar_fact_capacity.py": "6cf3e1f3a9b4cdab8f1b9d6d2ae8bc2778d396c5e4e7b9416fa954314389177c",
+  "upstream/zoology/analysis/capacity/mqar_repro_plots.py": "e9897daad0f78091939d7d988708810501594f4e6e92c406134c380e9881570a",
+  "upstream/zoology/analysis/mqar_plotting_example.py": "d59e78608231af34baa5baa02b21adec54ccf0ea406a47aaec553ed630527d32",
+  "upstream/zoology/analysis/paper/based_paper/based_figure1.py": "919dbcbc6e3098cc0f13acb0ef9ae289cf8cf8b078be9706e94d9ff59f1cf7d5",
+  "upstream/zoology/analysis/paper/based_paper/based_wall_clock.py": "192e111b3e02b28818ec4d10c89bfbb6b24c3afec635afbf7f66ee81176b4bae",
+  "upstream/zoology/analysis/paper/sabri/01-25_num_kv.py": "d1b8b113aed1fdd9bd021d40d90dd33baaae1f078ed2dcff96a24ce15479aae8",
+  "upstream/zoology/analysis/paper/sabri/01-26_tradeoff.py": "16fa0f3c39fb97d66eae6f9add72b9e78d11b30364ddc1eb8da1df183898d043",
+  "upstream/zoology/analysis/paper/sabri/01-27_traeoff.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/analysis/paper/zoology_paper/mqar_d_model.py": "be3cabc179a43c2019bb05f7a5a8dc4d35cd6c98a28af1814bdd91c184851eb7",
+  "upstream/zoology/analysis/paper/zoology_paper/mqar_taylor.py": "1762900e95d79332a00baf0180443013e780392088e740020fa9e84c5862c507",
+  "upstream/zoology/analysis/paper/zoology_paper/mqar_taylor_kv.py": "71c9fbaecbaa9a3263a14bcea92a3c3d6ab176244a3f0e20f56fbd2293420a26",
+  "upstream/zoology/analysis/paper/zoology_paper/num_kv.py": "9ffe1e9cce599fab39e116f61c36f83b5b1eb8879e0f382f0fa9e6471fe821e3",
+  "upstream/zoology/analysis/paper/zoology_paper/zoology_figure2.py": "940ccc8601f85abb4f6dd2deabcddc01d267f13f1da79660a6a8ad2c4c30eb42",
+  "upstream/zoology/analysis/utils.py": "290888694a9566fcbc519cf1d5ff42e5f295a0ceae1d079a8131704678c1d142",
+  "upstream/zoology/config.py": "6528d06a6a5f5cb167a843116a9d49cd3e9e3f7badc74c4f8a3f2a8faf4b9b91",
+  "upstream/zoology/data/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/data/ar_extrapolate.py": "4ade3204a92c3df781545b8748fca920ba137234ca2279ff3ece3ea52e00aa32",
+  "upstream/zoology/data/circuits.py": "c840251d356b429562aa042b8b0cab3be84c3c657d2511cb53ed7c1e408c3b38",
+  "upstream/zoology/data/compositional_mqar.py": "74d12d33d755c1bcce8c48cda56f179dc9c04d1b1abd509d5a1a26150329808f",
+  "upstream/zoology/data/forgetting_mqar.py": "fa20f397856b463ccc6b2fde4cf9b06a5f6256f70bd53f68be28e5a5e08d57b2",
+  "upstream/zoology/data/multiquery_ar.py": "d9d22c081a20f2da447d4d23cbde18c716e4f748b9e6236cb2d5adde796b3f29",
+  "upstream/zoology/data/stacked_mqar.py": "352b382941bd2c62cb638c6830f37454192abbc8fde59103c82b44449b5a360a",
+  "upstream/zoology/data/utils.py": "532170abcb36a086b2638e95796184e0f42612c66d4cc9bc4c34d892a5307c02",
+  "upstream/zoology/experiments/011126/mqar_continuous.py": "3c0b3241a5f20cd145b70ff5eb9b862d5f4254e773669d9427dd5508fb28fd86",
+  "upstream/zoology/experiments/011126/mqar_continuous_mse_loss.py": "32b968b1b0f4dab2c3de809e5dc0690c6353a0898c0ef27f7e2f59430470e555",
+  "upstream/zoology/experiments/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/experiments/basic_examples/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/experiments/basic_examples/basic.py": "69cbd3ec13ca98d13dc7c09799aa838a1411ced6ad8926268d241597d9befc54",
+  "upstream/zoology/experiments/basic_examples/basic_sweep.py": "f2b58f87447c487b3110e7be4d020b3eaab8c0a8e36eb80095c124e67d32e184",
+  "upstream/zoology/experiments/models_repo.py": "19e1c438fdfa88a538a78ad4edc822bc98d07642bc98092cfce6993f063217b8",
+  "upstream/zoology/experiments/mqar_example_configs/composition_configs.py": "e4d7eaf07954260edb407fe6d36d762b792f886d6017962c467a20df65f3c765",
+  "upstream/zoology/experiments/mqar_example_configs/composition_configs_random_false.py": "ee6843d320f6968563eaf708616ce8d5251b4ec699bcfcd89cf27d817c7384c8",
+  "upstream/zoology/experiments/mqar_example_configs/forgetting_configs.py": "5a1fdb058c5e7d04b5e4b6983478d428489c1291135ef3e4bad241ff3ab23629",
+  "upstream/zoology/experiments/mqar_example_configs/mqar_configs_random_false.py": "9ce23acde82665a56285ee4c98d8fbd0625e9acba34bcfda63dd291ab04f8fbc",
+  "upstream/zoology/experiments/mqar_example_configs/original_mqar_configs.py": "e599659b3b8d863de5946ec3cb037be9a7be9adf7eff73b52627e7f01db400cd",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-26_extrap.py": "412842831844afc4aca351fd58119c779a5735024626cc4c28dd6920652443d0",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-27_feature_map.py": "68d8ac3758082f132d229099fe5faad5052b579bb9c964288ffdda5e3a9c6213",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-27_tradeoff.py": "ad056f0282cb2a18f4bcb5096ce0d6f3aa351f032a9bd5b496626c369d899ef6",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-28_taylor_low.py": "069acc5ddee61dc2cc7c74c0a070a85715773eb91cdfc964b722671e68a9a5af",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-31_tradeoff.py": "3a57441cbe3411ed8376f8b3e46f7705a418a536ad7b76ca05f997cbd5481a39",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-01_sliding.py": "89ada96c94930b493324246a85387fa70a23e00fe91b53c43c6356d2790f318d",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-09_harder_yet.py": "9c07edd32ab2138b9abc583644bc4571073314c984fe57b35e1fd3ed7a08a5e1",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-09_new_feature_maps.py": "3015e18433f9cdf05cd43dcdbac9a38717d646503d16b0ced2a44eed41606f40",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/mqar_taylor_kv.py": "8774364410e3c738d70d7a21b5f46ca690b25ac373657f8b11f007e8bfb7533b",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_appendix/configs.py": "1cec03888000f3927e584711b221e0ebbd645459a7b5f3d291d25b57b454eaab",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_appendix/plot.py": "4b4ef9337af8354f9ee3a9f75eb569ea701c24f533aee1da1bbc50c0c30ee61b",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/README.md": "f2d6d8b5e3af9a056d02b94f5135cb0bb95abea25a09acd2d6bb16a74ce3f880",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/configs.py": "e6be1cd225bf76ab8f1135264886467b43729c8faae6bddef5874ce505693bf9",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/plot.py": "1b92399ae7d169832b469c7c31821a3bc669a7b01d46a65a7b52dfb78094fd64",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure3/configs.py": "bd1cb82c906965242c10051f36642e64345532b73624bb48ba40507a79ed92d7",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure3/plot.py": "fdb91b44e22c1b64bdd4e71f39cfa4f9bbcda6f6c8d39cd7a3beb0c3f67e80f2",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/binary_majority.py": "44edfe91ad7fae23e96d742ed909ae292687d36d1af42c5bbbf8410dd72ccce4",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/configs.py": "aef096c54b6162083cef5cd471335cf924c7863fb3d1f60f663914e755b0d45a",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/majority.py": "53a96d378a39d150be707761d720ccd2d8a52edcbf1e61e0c0bf6039d1457024",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/parity.py": "a1c87424f25610663df67fb15d08f45eb3ebf2a258a93e5c6942acf287908435",
+  "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_dmodel.py": "0aa9edd8e10324082793d9f44cc4ad14999085f640ced949bc370ebadafeabfa",
+  "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_taylor.py": "25f1be33503c182a76d1b28e0d7d56f9fdb88007e96fa66b782732ebe0c4b133",
+  "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_taylor_kv.py": "6b2970feec38354053ebbf191a82e530d3a89b5684ad4eaea17d063dbc7d6da2",
+  "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/README.md": "77152093b5357a1df7828969cf369d1cef2ef9c1273da5ca6316ae708acad0a4",
+  "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/configs.py": "c8d8dde92dd891bb5b32944a1fe65fbd1ec71819554ac81c44fe6ea265cdabbd",
+  "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/plot.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/launch.py": "bbc8b07be7c4a6c91274eba5984c2d873bb560d076d9d4cfe89b0fcadaa44c2d",
+  "upstream/zoology/logger.py": "b893d41737163e7839d01ada750dd753e2cd54021b570cf4cc647af13b052672",
+  "upstream/zoology/metrics.py": "30f7671670f456ca6c59adb54e358f85f864d1cfd7e7af3b936b6e625ddd8dfa",
+  "upstream/zoology/mixers/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/attention.py": "01a5b54afca83732b56a351000f16ec3c3d4eca0e9b4810027d27e3e79188856",
+  "upstream/zoology/mixers/base_conv.py": "ba6ef9bbb1bdff2cdc61132069ad7fe146e5abdaead6ed0b01b15ea27c2b28e8",
+  "upstream/zoology/mixers/based.py": "896010052b1932a725a19d7c70c36a80d1eb565af1953a0356ceeccf1be91cc8",
+  "upstream/zoology/mixers/bigbird.py": "02416ad0fad781c606fc3f32241132c123603fa2e886c2a53415e936bce1afd6",
+  "upstream/zoology/mixers/convolution.py": "a5b8a1b6cdf815cfe39d98c578dc3a3d80a030bf72f61644f65bab1e948cab05",
+  "upstream/zoology/mixers/deepseek/local_attention.py": "fe7a07bb2c0861388ccfba7e643cc90259ddcdc55642a4561aa7a63ca7397c34",
+  "upstream/zoology/mixers/deepseek/rotary.py": "e7036c6fbcf7d9c0114ee9b3b26401b865a6eb1ef81c08fe2d00c4281439a182",
+  "upstream/zoology/mixers/deepseek_nsa.py": "b40112585bffc416d259930a406ca499a8b699623aa21a1746fd799cf373da22",
+  "upstream/zoology/mixers/delta_net.py": "663175c6b1204c6d0aea427f628e9768e667cd90ca1652a5d75d60db90f711f1",
+  "upstream/zoology/mixers/feature_maps/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/feature_maps/all_poly.py": "bcd98450941acf6d47e999c4234bf9dd2d74276fed20a40cb13c0e28f2094c6c",
+  "upstream/zoology/mixers/feature_maps/base.py": "eee38fa9b28875792a9c5a7b82d86e3717e0c2cec79616903b469d5868154973",
+  "upstream/zoology/mixers/feature_maps/cosformer.py": "ce3816dc611599b43e5ca35eb6abe4e4763f5381e8fcb148659cc0d9580bcc44",
+  "upstream/zoology/mixers/feature_maps/exp_dim.py": "77e711e053de7d8b6970371ac913d6af6ce17a8cb7380ec9dcc30ff6fcb21de8",
+  "upstream/zoology/mixers/feature_maps/performer.py": "97be551950faec1e30f1bffddf905807233800caf3d52b6ed2b4605724a7683d",
+  "upstream/zoology/mixers/feature_maps/taylor.py": "b4cc2ba342763850915a8ee4e38476d73cf23281bcba64e4cba5eff18ad1f33c",
+  "upstream/zoology/mixers/gated_delta_net.py": "674dd32fb483ecf2ad5855aed7b9fc2fe95cd83a1937501395c828d3f3efba54",
+  "upstream/zoology/mixers/gla.py": "e29ab52a1e24264ffbd27f086ffadb24d9257e8fa66c962af6efb0ed81c4e98e",
+  "upstream/zoology/mixers/h3/__init__.py": "61baeefe5d34e8892656ebad1ccd1115894abe9dcd99b46537c609f98f969fef",
+  "upstream/zoology/mixers/h3/dplr.py": "76e764b87ae211b2e4aa1937d4187343606f34893eea77794bf58a7594feac8d",
+  "upstream/zoology/mixers/h3/h3.py": "2970534f9879e7000793f02e0a4f27cc22bd7c5b5c5610ad1b570945d007e845",
+  "upstream/zoology/mixers/h3/hippo.py": "781b41f259d91216bedf701e4747443e6aec5814af21047016013d9fd92764c8",
+  "upstream/zoology/mixers/h3/ops/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/h3/ops/fftconv.py": "b013ac4045864fbee1de82a89acccffa5438acb4fa12c1817c1a3ca1d1b3734d",
+  "upstream/zoology/mixers/h3/ops/krylov.py": "34f8b89ab034c699649cf6906a3fe52ea5d70551c87059d852d9af54e52cadbe",
+  "upstream/zoology/mixers/h3/ops/toeplitz.py": "41cbc75962d7c1d28da88856cb155b460c9471719fa632179447d482d1487124",
+  "upstream/zoology/mixers/h3/ops/vandermonde.py": "9534bfe44fb9628d1973a9253ba3ceb8858e21e366c9ee4512d705cbd1bf2163",
+  "upstream/zoology/mixers/h3/ss_kernel.py": "8d1d0db656a174b5403c0b0870c893c9ae5a2041087e47381759c1eb5b3b4b05",
+  "upstream/zoology/mixers/h3/ss_kernel_diag.py": "bc69455b99f7daeb25f382cf04e439706a9b5fba6811d610b3008d6488da6790",
+  "upstream/zoology/mixers/h3/ss_kernel_shift.py": "ccc622624c4656020d43036d7649acfbbf031b063daf132f52c28adab1e7062b",
+  "upstream/zoology/mixers/h3/ssm_utils.py": "4e2ad344fcfe1d5c6ac86a66c92f4c3935ecbb6562c7206f811095eca7eda1d8",
+  "upstream/zoology/mixers/hybrid.py": "e855a03ebaee79ad50ad342026651d4821a60cc69c674f06ebef40b98335537f",
+  "upstream/zoology/mixers/hyena.py": "e22d45babe794e873a183232ed35a0fa524f8d3af082ab4d466c78eb55c60429",
+  "upstream/zoology/mixers/listing.py": "12f227123e45ebf98215189a2e8c9f022a153317f5aa0a426c662e3bd51e8d1a",
+  "upstream/zoology/mixers/mamba.py": "0d0c250e0edac1a3f5f4a415f6e36cbc4cbe5dff416666d32e4d0c99ab727f31",
+  "upstream/zoology/mixers/mamba2.py": "9fa91391bdf70b82635d9bbee3d9455d04fdd5b741f5d10f12a6ad1eed9f813d",
+  "upstream/zoology/mixers/mamba_ssm/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/ops/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/ops/selective_scan_interface.py": "061e90aa71e2f4d783cc759d15f5896344548cc8ba66ad3050859df407026d7c",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/k_activations.py": "ffbb19486ce6f24ac7082f78915ce7cae40e1f507d39621ac964dd3c01468c26",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/layer_norm.py": "19b92346f5aa54c489fb19e6054552a0f6bb6fb8e4b3692417f0d9d83ec07144",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/layernorm.py": "a695126596345d3abadea9928550caf3eff74c13cda110cc0ca0a9596e93da97",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/layernorm_gated.py": "3a37ef83da00ec889598519e94e02438e38f7ddd29fb10ddcc423948f5fd7c35",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/selective_state_update.py": "2cad6e8464f06d504fecb2b5ac55edefc1fbdad1e2c10b345ae933d6ea8f9ca5",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/softplus.py": "1913728b87c1678922594319a8000287df4318c5420d4982dad7e427ca76bac7",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_bmm.py": "677e503a7d8950f848c0e51cf0f587bed3eb3e0a401adfb8b3eb33cd406b3c41",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_chunk_scan.py": "d67bdd87c5373bc33bf8cd255071fc10c8ed9b88ac51830a40aee11599b67a81",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_chunk_state.py": "7def68d10a9f50c7428349941effa742f8140daf99df83dc40e0db8db4efe3b9",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_combined.py": "a6f5383ac64b5db5d3f2ba68c6f3a68a7b0e4c6ea99d7b8e35ace7034dbd0e0f",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_state_passing.py": "a9ff7fca5b3d70433441a2526c5c9d88a8d26f915d16d9eb2e327aba39ae9522",
+  "upstream/zoology/mixers/mamba_ssm/selective_scan_interface.py": "eb1d25ef01bc909834a192beba616fbffc5d91bdcb4f267b52fb44035e358021",
+  "upstream/zoology/mixers/mamba_ssm/triton/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/triton/layernorm.py": "502788d223db325397969ad61166b3c56a09729acf1fd8b48b249ebc4582ed8f",
+  "upstream/zoology/mixers/mamba_ssm/triton/selective_state_update.py": "7053c88e64be5f8e2f26a776bf25ca2d85f5d506b6f112af48d87ab15a0f93a5",
+  "upstream/zoology/mixers/mlp.py": "eb03f4d04b84b8eb692bd98647e15abf1f168ae9b7953facb48693c1848b0fa6",
+  "upstream/zoology/mixers/mra/__init__.py": "f1b32ae4d6398e2f0bf125d8541a12edfbd0786632eb82865a9c04a44dde9c3b",
+  "upstream/zoology/mixers/mra/attention.py": "6ded4eeacbf1b24aea8dfcefe9d98e2af0c2b909b25cf238f3f5d7f589d43f99",
+  "upstream/zoology/mixers/mra/autograd_function.py": "b30a4d4084626e5d85fbebd00abf9c5ceb51e5f266c2b7cb5d2bfcf418a37164",
+  "upstream/zoology/mixers/mra/cuda/cuda_kernel.cu": "fad8eee8738ff59ebc00606c0cff6a100b3898288852e967f0b3e8f58672e167",
+  "upstream/zoology/mixers/mra/cuda/cuda_kernel.h": "58607c30a33c4980862edb5169c312f2327cbdbc3fd79f56f198c99525705465",
+  "upstream/zoology/mixers/mra/cuda/cuda_launch.cu": "9051d010bd80cd91a056349105b7c922468fcff06e713288b45741c5ec06e18e",
+  "upstream/zoology/mixers/mra/cuda/cuda_launch.h": "e006d7e5b11a1ff8e9ffbef67db4d5902896f2317f94662589d7bec6f488ce6b",
+  "upstream/zoology/mixers/mra/cuda/torch_extension.cpp": "6e64cac2cb7108264f15d9d961e3798b51d560c4c19a10d52c29ecfe466be331",
+  "upstream/zoology/mixers/mra/kernel.py": "27a5e962b027ae808e76f0ca1b95cf3a685d9a7b5ce3dfc9ea6b50cf0e621546",
+  "upstream/zoology/mixers/mra/mra.py": "9b9ea0deaa9c5f4be79db2c1d1f4e834a658005d02d8dd619d39a51cef4204f8",
+  "upstream/zoology/mixers/nysfromformer.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/nystromformer/__init__.py": "478954c54180640e228b722f89d7596fe174ee084737e6d6024942f1dd272ade",
+  "upstream/zoology/mixers/nystromformer/attn.py": "d55b1f8c3da6373d65f332efb0982752a0941dae01f9a368d0138cc41cc6aa91",
+  "upstream/zoology/mixers/nystromformer/attn_mask.py": "8c742f0943663b1e372ceab69fd6f0d22c046632cd501d1148015a5acdd3f73a",
+  "upstream/zoology/mixers/nystromformer/core.py": "a2767ad965e59a00dfef84c86754488d7f9f03fa38591e66f2b76668323428cb",
+  "upstream/zoology/mixers/nystromformer/nystromformer.py": "9fba6069a1aa7152ab6a8e76199ec9ccd28c6eb2f8a9fb4591d8e4428b9952b0",
+  "upstream/zoology/mixers/nystromformer/ops.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/nystromformer/utils.py": "7bd8fe104fa3c29ef6593e5095395f4a1f09c6fa080bc6daccb71ad6c07b8946",
+  "upstream/zoology/mixers/rwkv.py": "ed4e3b48aa94618006500a3e197127eaac2e8d4f0dae5ce36797c8984f75f266",
+  "upstream/zoology/mixers/rwkv/v4/wkv_cuda.cu": "1e74c2b9bc9917bf7ce55aa05b38ce5038485e7b7c787d21eb98103836a32ab4",
+  "upstream/zoology/mixers/rwkv/v4/wkv_op.cpp": "f9bcfbc615fa7d9e6623a9b91f0b802715b3814eb1c50595f41234d775f6cc10",
+  "upstream/zoology/mixers/rwkv/v5/wkv5_cuda.cu": "9b76f9bf7958cef301ff49d445ceca031a21e485fbec4453e801fbcbde6b6e45",
+  "upstream/zoology/mixers/rwkv/v5/wkv5_op.cpp": "2fc8efa6c6a50abee0849dbe6c7596483466de9d9098d42312983b2af45c8f6f",
+  "upstream/zoology/mixers/rwkv5.py": "bdbe6dd5de9274097c1c9eb52fce49ba7a75bdbac15210e21c45b67af0544116",
+  "upstream/zoology/mixers/rwkv7.py": "51fc5b7f7632a840bbd1866eb03146647b784e6e0696d8e019f0075b195d211a",
+  "upstream/zoology/mixers/scatterbrain/__init__.py": "e9ea7d53368d1e7994249c2c0fa5ca7dfa2961995dbbe11724870e0989afae19",
+  "upstream/zoology/mixers/scatterbrain/attn.py": "1676f9e02abaeda31eb65b594c4b37d20c194f08c4dc719a44937d6ea70daa63",
+  "upstream/zoology/mixers/scatterbrain/feature_maps_sb.py": "435341a1fae3ec18d28d1c59ef76fd7ddaa31e7790a731f69a2ed0614f7cdc54",
+  "upstream/zoology/mixers/scatterbrain/masking.py": "13f16706ce8cb21e3e457e9c561cca0695757b05ef83ad28a332d115dbceb37a",
+  "upstream/zoology/mixers/scatterbrain/projection_utils.py": "58361c02501e0f3947c3d978c9789f63caa65edc6c5abd35f60f0b5d95d647ba",
+  "upstream/zoology/mixers/scatterbrain/scatterbrain_utils.py": "6f836e9832ca563039bb752c50c7bc4b84bd7a03125573cc54d1340eef5ef0d5",
+  "upstream/zoology/mixers/scatterbrain_new.py": "67a3521b4607c6320b37d81d3826abd293444a6c72c8715f7a18f9fad872973c",
+  "upstream/zoology/mixers/selective.py": "cd2d58ae0ad53c2278f9437e3be871e215eb5a72d125ebf45e3ca2a5b1c99a3b",
+  "upstream/zoology/mixers/slide_attn.py": "d7af8113f3cd579c1337f306f47b7c79c820c66aff509c82572fbfbc1f3b33fb",
+  "upstream/zoology/mixers/ttt.py": "c75ff49adccee87198b0b8815fc3e264684c03c10bc46b87bb1d3ec6d1daba2a",
+  "upstream/zoology/model.py": "ec29777ff3f4ba7ac91b440a860c8769a6e9b8471a08a84d3e19a36488170fcb",
+  "upstream/zoology/train.py": "18128f75f468539ea725a4391028ea313c20b2f644530610354db930f74e4658",
+  "upstream/zoology/utils.py": "0bca95c777dfe73806895dac12efe5d0c4fda1edba19810a29866f5565891f57"
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e4_v1/source_manifest_before.json

@@ -0,0 +1,187 @@
+{
+  "code/discretization_mixing/__init__.py": "55f93431b8e7bff41a44bbb79c1648a5bbdef2a93c4e9ecb4679c894f29f5d69",
+  "code/discretization_mixing/core.py": "5863bf8dca6d233a209b5a36598f59154fe50e2f544b6a503ed09eee65187c71",
+  "code/discretization_mixing/coupled.py": "802c51172f9a27d69f347424e877d2cbc24c4a0290749fd2be5aa90f425a4261",
+  "code/discretization_mixing/emission_anchor.py": "da271fda1756cea05aa0d3b7ae1eed37a2d02613b1eeab361e714ae827186085",
+  "code/discretization_mixing/gauge.py": "c964aaefe68eee5fc13a0acbea0e038e2d7f65c93314c9cdec617594598eae05",
+  "code/discretization_mixing/models.py": "104a3ad97ec72c1ecedd292c60a84bded62672b625eba2a242ba8ecb66669ec0",
+  "code/discretization_mixing/poststate_replay.py": "21ac93d5ad61a5fdc4d79db0fcb33c513786b1abc2d12f6746c2e46702e107b6",
+  "code/discretization_mixing/poststate_replay_graph.py": "4bd496200c4783c4d4c736a005724053addb9da403b7d416a690ebcdd23eb664",
+  "code/discretization_mixing/preflight.py": "a15acc29f83ff6cf6a03b58a8df802dbd3ea74038f8eda2b83b98265ae586a2b",
+  "code/discretization_mixing/retimed_models.py": "dd1bbf697626c8daa9a4a6a0273b005a8c362e2ce1f310450106eb782e0104ff",
+  "code/discretization_mixing/run.py": "1920751b7bccfca56badee1a6e3718df5a6f5f41f6b87171974e29bd88ce63a3",
+  "code/discretization_mixing/tasks.py": "46ad130e70a352c8aeae975abd55198ec0afe0835ce1e833ccc9f1a6822f6dd9",
+  "code/discretization_mixing/verify.py": "1d2242e53b6793b6782275b782f2a895dae959173483a5a465027ff283e812fd",
+  "tests/test_zoology_adapter.py": "f3888c21ab63ddeb0c1a98f801ae0d72010185dba6e10dbb9c06dedbbf675ca2",
+  "tools/__init__.py": "9798da858190f4f16d85d4d4804cde32cb73df831e509f93e2028ec75831d981",
+  "tools/benchmarks/__init__.py": "871c0f71154e97f70b97d89123e297267134e6dfc98e37f4b8fe8710f3bb4fd2",
+  "tools/benchmarks/run_zoology_mqar.py": "374cc4831dd6bdf27ae37f1915e7498cab199f3bbaef647d2dfe0f7b274b3d7e",
+  "tools/research_audit/__init__.py": "03cb7cd7d94757ca20e8ed1b151a996f5b29e5b369f25afcf1504f13e23b0317",
+  "tools/research_audit/fast_tasks.py": "80d5395e841e939c64523002dd83aba14fa41000f23f306fbabc6e446ba205c2",
+  "upstream/LICENSE.md": "9d9baa9d20e3c6094f555bcc8e1d000cd91c692709a7e99379a5886304d95eea",
+  "upstream/README.md": "f2444ed90224ac1d4091cb7e0e8f435a00d342f84cc1b989689d1f81fb37b96f",
+  "upstream/setup.py": "a0e6e928972015dbd65ff13577eb982aa9f2469e8de66ee472a941859c9813ed",
+  "upstream/usage.md": "ba24fab59fd2991a06468b7475ccbe57d7424e1a45f72ce00acd88d3c73dda7b",
+  "upstream/zoology/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/analysis/__init__.py": "995f279d1d190305f2ca7a43e090ed2e63a8be1aa16f9fe78bbc727d4baa73c1",
+  "upstream/zoology/analysis/capacity/mqar_fact_capacity.py": "6cf3e1f3a9b4cdab8f1b9d6d2ae8bc2778d396c5e4e7b9416fa954314389177c",
+  "upstream/zoology/analysis/capacity/mqar_repro_plots.py": "e9897daad0f78091939d7d988708810501594f4e6e92c406134c380e9881570a",
+  "upstream/zoology/analysis/mqar_plotting_example.py": "d59e78608231af34baa5baa02b21adec54ccf0ea406a47aaec553ed630527d32",
+  "upstream/zoology/analysis/paper/based_paper/based_figure1.py": "919dbcbc6e3098cc0f13acb0ef9ae289cf8cf8b078be9706e94d9ff59f1cf7d5",
+  "upstream/zoology/analysis/paper/based_paper/based_wall_clock.py": "192e111b3e02b28818ec4d10c89bfbb6b24c3afec635afbf7f66ee81176b4bae",
+  "upstream/zoology/analysis/paper/sabri/01-25_num_kv.py": "d1b8b113aed1fdd9bd021d40d90dd33baaae1f078ed2dcff96a24ce15479aae8",
+  "upstream/zoology/analysis/paper/sabri/01-26_tradeoff.py": "16fa0f3c39fb97d66eae6f9add72b9e78d11b30364ddc1eb8da1df183898d043",
+  "upstream/zoology/analysis/paper/sabri/01-27_traeoff.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/analysis/paper/zoology_paper/mqar_d_model.py": "be3cabc179a43c2019bb05f7a5a8dc4d35cd6c98a28af1814bdd91c184851eb7",
+  "upstream/zoology/analysis/paper/zoology_paper/mqar_taylor.py": "1762900e95d79332a00baf0180443013e780392088e740020fa9e84c5862c507",
+  "upstream/zoology/analysis/paper/zoology_paper/mqar_taylor_kv.py": "71c9fbaecbaa9a3263a14bcea92a3c3d6ab176244a3f0e20f56fbd2293420a26",
+  "upstream/zoology/analysis/paper/zoology_paper/num_kv.py": "9ffe1e9cce599fab39e116f61c36f83b5b1eb8879e0f382f0fa9e6471fe821e3",
+  "upstream/zoology/analysis/paper/zoology_paper/zoology_figure2.py": "940ccc8601f85abb4f6dd2deabcddc01d267f13f1da79660a6a8ad2c4c30eb42",
+  "upstream/zoology/analysis/utils.py": "290888694a9566fcbc519cf1d5ff42e5f295a0ceae1d079a8131704678c1d142",
+  "upstream/zoology/config.py": "6528d06a6a5f5cb167a843116a9d49cd3e9e3f7badc74c4f8a3f2a8faf4b9b91",
+  "upstream/zoology/data/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/data/ar_extrapolate.py": "4ade3204a92c3df781545b8748fca920ba137234ca2279ff3ece3ea52e00aa32",
+  "upstream/zoology/data/circuits.py": "c840251d356b429562aa042b8b0cab3be84c3c657d2511cb53ed7c1e408c3b38",
+  "upstream/zoology/data/compositional_mqar.py": "74d12d33d755c1bcce8c48cda56f179dc9c04d1b1abd509d5a1a26150329808f",
+  "upstream/zoology/data/forgetting_mqar.py": "fa20f397856b463ccc6b2fde4cf9b06a5f6256f70bd53f68be28e5a5e08d57b2",
+  "upstream/zoology/data/multiquery_ar.py": "d9d22c081a20f2da447d4d23cbde18c716e4f748b9e6236cb2d5adde796b3f29",
+  "upstream/zoology/data/stacked_mqar.py": "352b382941bd2c62cb638c6830f37454192abbc8fde59103c82b44449b5a360a",
+  "upstream/zoology/data/utils.py": "532170abcb36a086b2638e95796184e0f42612c66d4cc9bc4c34d892a5307c02",
+  "upstream/zoology/experiments/011126/mqar_continuous.py": "3c0b3241a5f20cd145b70ff5eb9b862d5f4254e773669d9427dd5508fb28fd86",
+  "upstream/zoology/experiments/011126/mqar_continuous_mse_loss.py": "32b968b1b0f4dab2c3de809e5dc0690c6353a0898c0ef27f7e2f59430470e555",
+  "upstream/zoology/experiments/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/experiments/basic_examples/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/experiments/basic_examples/basic.py": "69cbd3ec13ca98d13dc7c09799aa838a1411ced6ad8926268d241597d9befc54",
+  "upstream/zoology/experiments/basic_examples/basic_sweep.py": "f2b58f87447c487b3110e7be4d020b3eaab8c0a8e36eb80095c124e67d32e184",
+  "upstream/zoology/experiments/models_repo.py": "19e1c438fdfa88a538a78ad4edc822bc98d07642bc98092cfce6993f063217b8",
+  "upstream/zoology/experiments/mqar_example_configs/composition_configs.py": "e4d7eaf07954260edb407fe6d36d762b792f886d6017962c467a20df65f3c765",
+  "upstream/zoology/experiments/mqar_example_configs/composition_configs_random_false.py": "ee6843d320f6968563eaf708616ce8d5251b4ec699bcfcd89cf27d817c7384c8",
+  "upstream/zoology/experiments/mqar_example_configs/forgetting_configs.py": "5a1fdb058c5e7d04b5e4b6983478d428489c1291135ef3e4bad241ff3ab23629",
+  "upstream/zoology/experiments/mqar_example_configs/mqar_configs_random_false.py": "9ce23acde82665a56285ee4c98d8fbd0625e9acba34bcfda63dd291ab04f8fbc",
+  "upstream/zoology/experiments/mqar_example_configs/original_mqar_configs.py": "e599659b3b8d863de5946ec3cb037be9a7be9adf7eff73b52627e7f01db400cd",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-26_extrap.py": "412842831844afc4aca351fd58119c779a5735024626cc4c28dd6920652443d0",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-27_feature_map.py": "68d8ac3758082f132d229099fe5faad5052b579bb9c964288ffdda5e3a9c6213",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-27_tradeoff.py": "ad056f0282cb2a18f4bcb5096ce0d6f3aa351f032a9bd5b496626c369d899ef6",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-28_taylor_low.py": "069acc5ddee61dc2cc7c74c0a070a85715773eb91cdfc964b722671e68a9a5af",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-31_tradeoff.py": "3a57441cbe3411ed8376f8b3e46f7705a418a536ad7b76ca05f997cbd5481a39",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-01_sliding.py": "89ada96c94930b493324246a85387fa70a23e00fe91b53c43c6356d2790f318d",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-09_harder_yet.py": "9c07edd32ab2138b9abc583644bc4571073314c984fe57b35e1fd3ed7a08a5e1",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-09_new_feature_maps.py": "3015e18433f9cdf05cd43dcdbac9a38717d646503d16b0ced2a44eed41606f40",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/mqar_taylor_kv.py": "8774364410e3c738d70d7a21b5f46ca690b25ac373657f8b11f007e8bfb7533b",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_appendix/configs.py": "1cec03888000f3927e584711b221e0ebbd645459a7b5f3d291d25b57b454eaab",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_appendix/plot.py": "4b4ef9337af8354f9ee3a9f75eb569ea701c24f533aee1da1bbc50c0c30ee61b",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/README.md": "f2d6d8b5e3af9a056d02b94f5135cb0bb95abea25a09acd2d6bb16a74ce3f880",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/configs.py": "e6be1cd225bf76ab8f1135264886467b43729c8faae6bddef5874ce505693bf9",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/plot.py": "1b92399ae7d169832b469c7c31821a3bc669a7b01d46a65a7b52dfb78094fd64",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure3/configs.py": "bd1cb82c906965242c10051f36642e64345532b73624bb48ba40507a79ed92d7",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_figure3/plot.py": "fdb91b44e22c1b64bdd4e71f39cfa4f9bbcda6f6c8d39cd7a3beb0c3f67e80f2",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/binary_majority.py": "44edfe91ad7fae23e96d742ed909ae292687d36d1af42c5bbbf8410dd72ccce4",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/configs.py": "aef096c54b6162083cef5cd471335cf924c7863fb3d1f60f663914e755b0d45a",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/majority.py": "53a96d378a39d150be707761d720ccd2d8a52edcbf1e61e0c0bf6039d1457024",
+  "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/parity.py": "a1c87424f25610663df67fb15d08f45eb3ebf2a258a93e5c6942acf287908435",
+  "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_dmodel.py": "0aa9edd8e10324082793d9f44cc4ad14999085f640ced949bc370ebadafeabfa",
+  "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_taylor.py": "25f1be33503c182a76d1b28e0d7d56f9fdb88007e96fa66b782732ebe0c4b133",
+  "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_taylor_kv.py": "6b2970feec38354053ebbf191a82e530d3a89b5684ad4eaea17d063dbc7d6da2",
+  "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/README.md": "77152093b5357a1df7828969cf369d1cef2ef9c1273da5ca6316ae708acad0a4",
+  "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/configs.py": "c8d8dde92dd891bb5b32944a1fe65fbd1ec71819554ac81c44fe6ea265cdabbd",
+  "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/plot.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/launch.py": "bbc8b07be7c4a6c91274eba5984c2d873bb560d076d9d4cfe89b0fcadaa44c2d",
+  "upstream/zoology/logger.py": "b893d41737163e7839d01ada750dd753e2cd54021b570cf4cc647af13b052672",
+  "upstream/zoology/metrics.py": "30f7671670f456ca6c59adb54e358f85f864d1cfd7e7af3b936b6e625ddd8dfa",
+  "upstream/zoology/mixers/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/attention.py": "01a5b54afca83732b56a351000f16ec3c3d4eca0e9b4810027d27e3e79188856",
+  "upstream/zoology/mixers/base_conv.py": "ba6ef9bbb1bdff2cdc61132069ad7fe146e5abdaead6ed0b01b15ea27c2b28e8",
+  "upstream/zoology/mixers/based.py": "896010052b1932a725a19d7c70c36a80d1eb565af1953a0356ceeccf1be91cc8",
+  "upstream/zoology/mixers/bigbird.py": "02416ad0fad781c606fc3f32241132c123603fa2e886c2a53415e936bce1afd6",
+  "upstream/zoology/mixers/convolution.py": "a5b8a1b6cdf815cfe39d98c578dc3a3d80a030bf72f61644f65bab1e948cab05",
+  "upstream/zoology/mixers/deepseek/local_attention.py": "fe7a07bb2c0861388ccfba7e643cc90259ddcdc55642a4561aa7a63ca7397c34",
+  "upstream/zoology/mixers/deepseek/rotary.py": "e7036c6fbcf7d9c0114ee9b3b26401b865a6eb1ef81c08fe2d00c4281439a182",
+  "upstream/zoology/mixers/deepseek_nsa.py": "b40112585bffc416d259930a406ca499a8b699623aa21a1746fd799cf373da22",
+  "upstream/zoology/mixers/delta_net.py": "663175c6b1204c6d0aea427f628e9768e667cd90ca1652a5d75d60db90f711f1",
+  "upstream/zoology/mixers/feature_maps/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/feature_maps/all_poly.py": "bcd98450941acf6d47e999c4234bf9dd2d74276fed20a40cb13c0e28f2094c6c",
+  "upstream/zoology/mixers/feature_maps/base.py": "eee38fa9b28875792a9c5a7b82d86e3717e0c2cec79616903b469d5868154973",
+  "upstream/zoology/mixers/feature_maps/cosformer.py": "ce3816dc611599b43e5ca35eb6abe4e4763f5381e8fcb148659cc0d9580bcc44",
+  "upstream/zoology/mixers/feature_maps/exp_dim.py": "77e711e053de7d8b6970371ac913d6af6ce17a8cb7380ec9dcc30ff6fcb21de8",
+  "upstream/zoology/mixers/feature_maps/performer.py": "97be551950faec1e30f1bffddf905807233800caf3d52b6ed2b4605724a7683d",
+  "upstream/zoology/mixers/feature_maps/taylor.py": "b4cc2ba342763850915a8ee4e38476d73cf23281bcba64e4cba5eff18ad1f33c",
+  "upstream/zoology/mixers/gated_delta_net.py": "674dd32fb483ecf2ad5855aed7b9fc2fe95cd83a1937501395c828d3f3efba54",
+  "upstream/zoology/mixers/gla.py": "e29ab52a1e24264ffbd27f086ffadb24d9257e8fa66c962af6efb0ed81c4e98e",
+  "upstream/zoology/mixers/h3/__init__.py": "61baeefe5d34e8892656ebad1ccd1115894abe9dcd99b46537c609f98f969fef",
+  "upstream/zoology/mixers/h3/dplr.py": "76e764b87ae211b2e4aa1937d4187343606f34893eea77794bf58a7594feac8d",
+  "upstream/zoology/mixers/h3/h3.py": "2970534f9879e7000793f02e0a4f27cc22bd7c5b5c5610ad1b570945d007e845",
+  "upstream/zoology/mixers/h3/hippo.py": "781b41f259d91216bedf701e4747443e6aec5814af21047016013d9fd92764c8",
+  "upstream/zoology/mixers/h3/ops/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/h3/ops/fftconv.py": "b013ac4045864fbee1de82a89acccffa5438acb4fa12c1817c1a3ca1d1b3734d",
+  "upstream/zoology/mixers/h3/ops/krylov.py": "34f8b89ab034c699649cf6906a3fe52ea5d70551c87059d852d9af54e52cadbe",
+  "upstream/zoology/mixers/h3/ops/toeplitz.py": "41cbc75962d7c1d28da88856cb155b460c9471719fa632179447d482d1487124",
+  "upstream/zoology/mixers/h3/ops/vandermonde.py": "9534bfe44fb9628d1973a9253ba3ceb8858e21e366c9ee4512d705cbd1bf2163",
+  "upstream/zoology/mixers/h3/ss_kernel.py": "8d1d0db656a174b5403c0b0870c893c9ae5a2041087e47381759c1eb5b3b4b05",
+  "upstream/zoology/mixers/h3/ss_kernel_diag.py": "bc69455b99f7daeb25f382cf04e439706a9b5fba6811d610b3008d6488da6790",
+  "upstream/zoology/mixers/h3/ss_kernel_shift.py": "ccc622624c4656020d43036d7649acfbbf031b063daf132f52c28adab1e7062b",
+  "upstream/zoology/mixers/h3/ssm_utils.py": "4e2ad344fcfe1d5c6ac86a66c92f4c3935ecbb6562c7206f811095eca7eda1d8",
+  "upstream/zoology/mixers/hybrid.py": "e855a03ebaee79ad50ad342026651d4821a60cc69c674f06ebef40b98335537f",
+  "upstream/zoology/mixers/hyena.py": "e22d45babe794e873a183232ed35a0fa524f8d3af082ab4d466c78eb55c60429",
+  "upstream/zoology/mixers/listing.py": "12f227123e45ebf98215189a2e8c9f022a153317f5aa0a426c662e3bd51e8d1a",
+  "upstream/zoology/mixers/mamba.py": "0d0c250e0edac1a3f5f4a415f6e36cbc4cbe5dff416666d32e4d0c99ab727f31",
+  "upstream/zoology/mixers/mamba2.py": "9fa91391bdf70b82635d9bbee3d9455d04fdd5b741f5d10f12a6ad1eed9f813d",
+  "upstream/zoology/mixers/mamba_ssm/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/ops/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/ops/selective_scan_interface.py": "061e90aa71e2f4d783cc759d15f5896344548cc8ba66ad3050859df407026d7c",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/k_activations.py": "ffbb19486ce6f24ac7082f78915ce7cae40e1f507d39621ac964dd3c01468c26",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/layer_norm.py": "19b92346f5aa54c489fb19e6054552a0f6bb6fb8e4b3692417f0d9d83ec07144",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/layernorm.py": "a695126596345d3abadea9928550caf3eff74c13cda110cc0ca0a9596e93da97",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/layernorm_gated.py": "3a37ef83da00ec889598519e94e02438e38f7ddd29fb10ddcc423948f5fd7c35",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/selective_state_update.py": "2cad6e8464f06d504fecb2b5ac55edefc1fbdad1e2c10b345ae933d6ea8f9ca5",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/softplus.py": "1913728b87c1678922594319a8000287df4318c5420d4982dad7e427ca76bac7",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_bmm.py": "677e503a7d8950f848c0e51cf0f587bed3eb3e0a401adfb8b3eb33cd406b3c41",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_chunk_scan.py": "d67bdd87c5373bc33bf8cd255071fc10c8ed9b88ac51830a40aee11599b67a81",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_chunk_state.py": "7def68d10a9f50c7428349941effa742f8140daf99df83dc40e0db8db4efe3b9",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_combined.py": "a6f5383ac64b5db5d3f2ba68c6f3a68a7b0e4c6ea99d7b8e35ace7034dbd0e0f",
+  "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_state_passing.py": "a9ff7fca5b3d70433441a2526c5c9d88a8d26f915d16d9eb2e327aba39ae9522",
+  "upstream/zoology/mixers/mamba_ssm/selective_scan_interface.py": "eb1d25ef01bc909834a192beba616fbffc5d91bdcb4f267b52fb44035e358021",
+  "upstream/zoology/mixers/mamba_ssm/triton/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/mamba_ssm/triton/layernorm.py": "502788d223db325397969ad61166b3c56a09729acf1fd8b48b249ebc4582ed8f",
+  "upstream/zoology/mixers/mamba_ssm/triton/selective_state_update.py": "7053c88e64be5f8e2f26a776bf25ca2d85f5d506b6f112af48d87ab15a0f93a5",
+  "upstream/zoology/mixers/mlp.py": "eb03f4d04b84b8eb692bd98647e15abf1f168ae9b7953facb48693c1848b0fa6",
+  "upstream/zoology/mixers/mra/__init__.py": "f1b32ae4d6398e2f0bf125d8541a12edfbd0786632eb82865a9c04a44dde9c3b",
+  "upstream/zoology/mixers/mra/attention.py": "6ded4eeacbf1b24aea8dfcefe9d98e2af0c2b909b25cf238f3f5d7f589d43f99",
+  "upstream/zoology/mixers/mra/autograd_function.py": "b30a4d4084626e5d85fbebd00abf9c5ceb51e5f266c2b7cb5d2bfcf418a37164",
+  "upstream/zoology/mixers/mra/cuda/cuda_kernel.cu": "fad8eee8738ff59ebc00606c0cff6a100b3898288852e967f0b3e8f58672e167",
+  "upstream/zoology/mixers/mra/cuda/cuda_kernel.h": "58607c30a33c4980862edb5169c312f2327cbdbc3fd79f56f198c99525705465",
+  "upstream/zoology/mixers/mra/cuda/cuda_launch.cu": "9051d010bd80cd91a056349105b7c922468fcff06e713288b45741c5ec06e18e",
+  "upstream/zoology/mixers/mra/cuda/cuda_launch.h": "e006d7e5b11a1ff8e9ffbef67db4d5902896f2317f94662589d7bec6f488ce6b",
+  "upstream/zoology/mixers/mra/cuda/torch_extension.cpp": "6e64cac2cb7108264f15d9d961e3798b51d560c4c19a10d52c29ecfe466be331",
+  "upstream/zoology/mixers/mra/kernel.py": "27a5e962b027ae808e76f0ca1b95cf3a685d9a7b5ce3dfc9ea6b50cf0e621546",
+  "upstream/zoology/mixers/mra/mra.py": "9b9ea0deaa9c5f4be79db2c1d1f4e834a658005d02d8dd619d39a51cef4204f8",
+  "upstream/zoology/mixers/nysfromformer.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/nystromformer/__init__.py": "478954c54180640e228b722f89d7596fe174ee084737e6d6024942f1dd272ade",
+  "upstream/zoology/mixers/nystromformer/attn.py": "d55b1f8c3da6373d65f332efb0982752a0941dae01f9a368d0138cc41cc6aa91",
+  "upstream/zoology/mixers/nystromformer/attn_mask.py": "8c742f0943663b1e372ceab69fd6f0d22c046632cd501d1148015a5acdd3f73a",
+  "upstream/zoology/mixers/nystromformer/core.py": "a2767ad965e59a00dfef84c86754488d7f9f03fa38591e66f2b76668323428cb",
+  "upstream/zoology/mixers/nystromformer/nystromformer.py": "9fba6069a1aa7152ab6a8e76199ec9ccd28c6eb2f8a9fb4591d8e4428b9952b0",
+  "upstream/zoology/mixers/nystromformer/ops.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
+  "upstream/zoology/mixers/nystromformer/utils.py": "7bd8fe104fa3c29ef6593e5095395f4a1f09c6fa080bc6daccb71ad6c07b8946",
+  "upstream/zoology/mixers/rwkv.py": "ed4e3b48aa94618006500a3e197127eaac2e8d4f0dae5ce36797c8984f75f266",
+  "upstream/zoology/mixers/rwkv/v4/wkv_cuda.cu": "1e74c2b9bc9917bf7ce55aa05b38ce5038485e7b7c787d21eb98103836a32ab4",
+  "upstream/zoology/mixers/rwkv/v4/wkv_op.cpp": "f9bcfbc615fa7d9e6623a9b91f0b802715b3814eb1c50595f41234d775f6cc10",
+  "upstream/zoology/mixers/rwkv/v5/wkv5_cuda.cu": "9b76f9bf7958cef301ff49d445ceca031a21e485fbec4453e801fbcbde6b6e45",
+  "upstream/zoology/mixers/rwkv/v5/wkv5_op.cpp": "2fc8efa6c6a50abee0849dbe6c7596483466de9d9098d42312983b2af45c8f6f",
+  "upstream/zoology/mixers/rwkv5.py": "bdbe6dd5de9274097c1c9eb52fce49ba7a75bdbac15210e21c45b67af0544116",
+  "upstream/zoology/mixers/rwkv7.py": "51fc5b7f7632a840bbd1866eb03146647b784e6e0696d8e019f0075b195d211a",
+  "upstream/zoology/mixers/scatterbrain/__init__.py": "e9ea7d53368d1e7994249c2c0fa5ca7dfa2961995dbbe11724870e0989afae19",
+  "upstream/zoology/mixers/scatterbrain/attn.py": "1676f9e02abaeda31eb65b594c4b37d20c194f08c4dc719a44937d6ea70daa63",
+  "upstream/zoology/mixers/scatterbrain/feature_maps_sb.py": "435341a1fae3ec18d28d1c59ef76fd7ddaa31e7790a731f69a2ed0614f7cdc54",
+  "upstream/zoology/mixers/scatterbrain/masking.py": "13f16706ce8cb21e3e457e9c561cca0695757b05ef83ad28a332d115dbceb37a",
+  "upstream/zoology/mixers/scatterbrain/projection_utils.py": "58361c02501e0f3947c3d978c9789f63caa65edc6c5abd35f60f0b5d95d647ba",
+  "upstream/zoology/mixers/scatterbrain/scatterbrain_utils.py": "6f836e9832ca563039bb752c50c7bc4b84bd7a03125573cc54d1340eef5ef0d5",
+  "upstream/zoology/mixers/scatterbrain_new.py": "67a3521b4607c6320b37d81d3826abd293444a6c72c8715f7a18f9fad872973c",
+  "upstream/zoology/mixers/selective.py": "cd2d58ae0ad53c2278f9437e3be871e215eb5a72d125ebf45e3ca2a5b1c99a3b",
+  "upstream/zoology/mixers/slide_attn.py": "d7af8113f3cd579c1337f306f47b7c79c820c66aff509c82572fbfbc1f3b33fb",
+  "upstream/zoology/mixers/ttt.py": "c75ff49adccee87198b0b8815fc3e264684c03c10bc46b87bb1d3ec6d1daba2a",
+  "upstream/zoology/model.py": "ec29777ff3f4ba7ac91b440a860c8769a6e9b8471a08a84d3e19a36488170fcb",
+  "upstream/zoology/train.py": "18128f75f468539ea725a4391028ea313c20b2f644530610354db930f74e4658",
+  "upstream/zoology/utils.py": "0bca95c777dfe73806895dac12efe5d0c4fda1edba19810a29866f5565891f57"
+}

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e4_v1/source_snapshot_minimal.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:711c302806e9b2eb90ae94ae4d06463a77c93ae144d8e3664a05b1aceb572e9c
+size 71588

checkpoints/official_zoology_mqar_data/v100_full_iclr24_L64_P4_endpoint_s11_lr1e4_v1/source_subset_manifest.json

@@ -0,0 +1,266 @@
+{
+  "original_snapshot_sha256": "fe1cbc796ccdb79351cab3f8e4e323740877c87051b4cc745950311449d9425d",
+  "published_subset_sha256": "711c302806e9b2eb90ae94ae4d06463a77c93ae144d8e3664a05b1aceb572e9c",
+  "included_exact_bytes": [
+    {
+      "path": "code/discretization_mixing/__init__.py",
+      "sha256": "55f93431b8e7bff41a44bbb79c1648a5bbdef2a93c4e9ecb4679c894f29f5d69",
+      "bytes": 83
+    },
+    {
+      "path": "code/discretization_mixing/core.py",
+      "sha256": "5863bf8dca6d233a209b5a36598f59154fe50e2f544b6a503ed09eee65187c71",
+      "bytes": 4762
+    },
+    {
+      "path": "code/discretization_mixing/coupled.py",
+      "sha256": "802c51172f9a27d69f347424e877d2cbc24c4a0290749fd2be5aa90f425a4261",
+      "bytes": 29828
+    },
+    {
+      "path": "code/discretization_mixing/emission_anchor.py",
+      "sha256": "da271fda1756cea05aa0d3b7ae1eed37a2d02613b1eeab361e714ae827186085",
+      "bytes": 32529
+    },
+    {
+      "path": "code/discretization_mixing/gauge.py",
+      "sha256": "c964aaefe68eee5fc13a0acbea0e038e2d7f65c93314c9cdec617594598eae05",
+      "bytes": 6869
+    },
+    {
+      "path": "code/discretization_mixing/models.py",
+      "sha256": "104a3ad97ec72c1ecedd292c60a84bded62672b625eba2a242ba8ecb66669ec0",
+      "bytes": 8644
+    },
+    {
+      "path": "code/discretization_mixing/poststate_replay.py",
+      "sha256": "21ac93d5ad61a5fdc4d79db0fcb33c513786b1abc2d12f6746c2e46702e107b6",
+      "bytes": 32946
+    },
+    {
+      "path": "code/discretization_mixing/poststate_replay_graph.py",
+      "sha256": "4bd496200c4783c4d4c736a005724053addb9da403b7d416a690ebcdd23eb664",
+      "bytes": 33583
+    },
+    {
+      "path": "code/discretization_mixing/preflight.py",
+      "sha256": "a15acc29f83ff6cf6a03b58a8df802dbd3ea74038f8eda2b83b98265ae586a2b",
+      "bytes": 2697
+    },
+    {
+      "path": "code/discretization_mixing/retimed_models.py",
+      "sha256": "dd1bbf697626c8daa9a4a6a0273b005a8c362e2ce1f310450106eb782e0104ff",
+      "bytes": 23950
+    },
+    {
+      "path": "code/discretization_mixing/run.py",
+      "sha256": "1920751b7bccfca56badee1a6e3718df5a6f5f41f6b87171974e29bd88ce63a3",
+      "bytes": 10731
+    },
+    {
+      "path": "code/discretization_mixing/tasks.py",
+      "sha256": "46ad130e70a352c8aeae975abd55198ec0afe0835ce1e833ccc9f1a6822f6dd9",
+      "bytes": 3260
+    },
+    {
+      "path": "code/discretization_mixing/verify.py",
+      "sha256": "1d2242e53b6793b6782275b782f2a895dae959173483a5a465027ff283e812fd",
+      "bytes": 4417
+    },
+    {
+      "path": "tools/__init__.py",
+      "sha256": "9798da858190f4f16d85d4d4804cde32cb73df831e509f93e2028ec75831d981",
+      "bytes": 36
+    },
+    {
+      "path": "tools/benchmarks/__init__.py",
+      "sha256": "871c0f71154e97f70b97d89123e297267134e6dfc98e37f4b8fe8710f3bb4fd2",
+      "bytes": 75
+    },
+    {
+      "path": "tools/benchmarks/run_zoology_mqar.py",
+      "sha256": "374cc4831dd6bdf27ae37f1915e7498cab199f3bbaef647d2dfe0f7b274b3d7e",
+      "bytes": 34081
+    },
+    {
+      "path": "tools/research_audit/__init__.py",
+      "sha256": "03cb7cd7d94757ca20e8ed1b151a996f5b29e5b369f25afcf1504f13e23b0317",
+      "bytes": 69
+    },
+    {
+      "path": "tools/research_audit/fast_tasks.py",
+      "sha256": "80d5395e841e939c64523002dd83aba14fa41000f23f306fbabc6e446ba205c2",
+      "bytes": 13280
+    }
+  ],
+  "omitted_paths": [
+    "tests/test_zoology_adapter.py",
+    "upstream/LICENSE.md",
+    "upstream/README.md",
+    "upstream/setup.py",
+    "upstream/usage.md",
+    "upstream/zoology/__init__.py",
+    "upstream/zoology/analysis/__init__.py",
+    "upstream/zoology/analysis/capacity/mqar_fact_capacity.py",
+    "upstream/zoology/analysis/capacity/mqar_repro_plots.py",
+    "upstream/zoology/analysis/mqar_plotting_example.py",
+    "upstream/zoology/analysis/paper/based_paper/based_figure1.py",
+    "upstream/zoology/analysis/paper/based_paper/based_wall_clock.py",
+    "upstream/zoology/analysis/paper/sabri/01-25_num_kv.py",
+    "upstream/zoology/analysis/paper/sabri/01-26_tradeoff.py",
+    "upstream/zoology/analysis/paper/sabri/01-27_traeoff.py",
+    "upstream/zoology/analysis/paper/zoology_paper/mqar_d_model.py",
+    "upstream/zoology/analysis/paper/zoology_paper/mqar_taylor.py",
+    "upstream/zoology/analysis/paper/zoology_paper/mqar_taylor_kv.py",
+    "upstream/zoology/analysis/paper/zoology_paper/num_kv.py",
+    "upstream/zoology/analysis/paper/zoology_paper/zoology_figure2.py",
+    "upstream/zoology/analysis/utils.py",
+    "upstream/zoology/config.py",
+    "upstream/zoology/data/__init__.py",
+    "upstream/zoology/data/ar_extrapolate.py",
+    "upstream/zoology/data/circuits.py",
+    "upstream/zoology/data/compositional_mqar.py",
+    "upstream/zoology/data/forgetting_mqar.py",
+    "upstream/zoology/data/multiquery_ar.py",
+    "upstream/zoology/data/stacked_mqar.py",
+    "upstream/zoology/data/utils.py",
+    "upstream/zoology/experiments/011126/mqar_continuous.py",
+    "upstream/zoology/experiments/011126/mqar_continuous_mse_loss.py",
+    "upstream/zoology/experiments/__init__.py",
+    "upstream/zoology/experiments/basic_examples/__init__.py",
+    "upstream/zoology/experiments/basic_examples/basic.py",
+    "upstream/zoology/experiments/basic_examples/basic_sweep.py",
+    "upstream/zoology/experiments/models_repo.py",
+    "upstream/zoology/experiments/mqar_example_configs/composition_configs.py",
+    "upstream/zoology/experiments/mqar_example_configs/composition_configs_random_false.py",
+    "upstream/zoology/experiments/mqar_example_configs/forgetting_configs.py",
+    "upstream/zoology/experiments/mqar_example_configs/mqar_configs_random_false.py",
+    "upstream/zoology/experiments/mqar_example_configs/original_mqar_configs.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-26_extrap.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-27_feature_map.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-27_tradeoff.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-28_taylor_low.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/01-31_tradeoff.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-01_sliding.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-09_harder_yet.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/02-09_new_feature_maps.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/__init__.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_ablations/mqar_taylor_kv.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_appendix/configs.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_appendix/plot.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/README.md",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/configs.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_figure2/plot.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_figure3/configs.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_figure3/plot.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/binary_majority.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/configs.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/majority.py",
+    "upstream/zoology/experiments/paper_configs/arxiv24_based_rebuttal_circuits/parity.py",
+    "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_dmodel.py",
+    "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_taylor.py",
+    "upstream/zoology/experiments/paper_configs/iclr24_explore_configs/mqar_taylor_kv.py",
+    "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/README.md",
+    "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/configs.py",
+    "upstream/zoology/experiments/paper_configs/iclr24_zoology_figure2/plot.py",
+    "upstream/zoology/launch.py",
+    "upstream/zoology/logger.py",
+    "upstream/zoology/metrics.py",
+    "upstream/zoology/mixers/__init__.py",
+    "upstream/zoology/mixers/attention.py",
+    "upstream/zoology/mixers/base_conv.py",
+    "upstream/zoology/mixers/based.py",
+    "upstream/zoology/mixers/bigbird.py",
+    "upstream/zoology/mixers/convolution.py",
+    "upstream/zoology/mixers/deepseek/local_attention.py",
+    "upstream/zoology/mixers/deepseek/rotary.py",
+    "upstream/zoology/mixers/deepseek_nsa.py",
+    "upstream/zoology/mixers/delta_net.py",
+    "upstream/zoology/mixers/feature_maps/__init__.py",
+    "upstream/zoology/mixers/feature_maps/all_poly.py",
+    "upstream/zoology/mixers/feature_maps/base.py",
+    "upstream/zoology/mixers/feature_maps/cosformer.py",
+    "upstream/zoology/mixers/feature_maps/exp_dim.py",
+    "upstream/zoology/mixers/feature_maps/performer.py",
+    "upstream/zoology/mixers/feature_maps/taylor.py",
+    "upstream/zoology/mixers/gated_delta_net.py",
+    "upstream/zoology/mixers/gla.py",
+    "upstream/zoology/mixers/h3/__init__.py",
+    "upstream/zoology/mixers/h3/dplr.py",
+    "upstream/zoology/mixers/h3/h3.py",
+    "upstream/zoology/mixers/h3/hippo.py",
+    "upstream/zoology/mixers/h3/ops/__init__.py",
+    "upstream/zoology/mixers/h3/ops/fftconv.py",
+    "upstream/zoology/mixers/h3/ops/krylov.py",
+    "upstream/zoology/mixers/h3/ops/toeplitz.py",
+    "upstream/zoology/mixers/h3/ops/vandermonde.py",
+    "upstream/zoology/mixers/h3/ss_kernel.py",
+    "upstream/zoology/mixers/h3/ss_kernel_diag.py",
+    "upstream/zoology/mixers/h3/ss_kernel_shift.py",
+    "upstream/zoology/mixers/h3/ssm_utils.py",
+    "upstream/zoology/mixers/hybrid.py",
+    "upstream/zoology/mixers/hyena.py",
+    "upstream/zoology/mixers/listing.py",
+    "upstream/zoology/mixers/mamba.py",
+    "upstream/zoology/mixers/mamba2.py",
+    "upstream/zoology/mixers/mamba_ssm/__init__.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/__init__.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/selective_scan_interface.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/__init__.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/k_activations.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/layer_norm.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/layernorm.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/layernorm_gated.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/selective_state_update.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/softplus.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_bmm.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_chunk_scan.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_chunk_state.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_combined.py",
+    "upstream/zoology/mixers/mamba_ssm/ops/triton/ssd_state_passing.py",
+    "upstream/zoology/mixers/mamba_ssm/selective_scan_interface.py",
+    "upstream/zoology/mixers/mamba_ssm/triton/__init__.py",
+    "upstream/zoology/mixers/mamba_ssm/triton/layernorm.py",
+    "upstream/zoology/mixers/mamba_ssm/triton/selective_state_update.py",
+    "upstream/zoology/mixers/mlp.py",
+    "upstream/zoology/mixers/mra/__init__.py",
+    "upstream/zoology/mixers/mra/attention.py",
+    "upstream/zoology/mixers/mra/autograd_function.py",
+    "upstream/zoology/mixers/mra/cuda/cuda_kernel.cu",
+    "upstream/zoology/mixers/mra/cuda/cuda_kernel.h",
+    "upstream/zoology/mixers/mra/cuda/cuda_launch.cu",
+    "upstream/zoology/mixers/mra/cuda/cuda_launch.h",
+    "upstream/zoology/mixers/mra/cuda/torch_extension.cpp",
+    "upstream/zoology/mixers/mra/kernel.py",
+    "upstream/zoology/mixers/mra/mra.py",
+    "upstream/zoology/mixers/nysfromformer.py",
+    "upstream/zoology/mixers/nystromformer/__init__.py",
+    "upstream/zoology/mixers/nystromformer/attn.py",
+    "upstream/zoology/mixers/nystromformer/attn_mask.py",
+    "upstream/zoology/mixers/nystromformer/core.py",
+    "upstream/zoology/mixers/nystromformer/nystromformer.py",
+    "upstream/zoology/mixers/nystromformer/ops.py",
+    "upstream/zoology/mixers/nystromformer/utils.py",
+    "upstream/zoology/mixers/rwkv.py",
+    "upstream/zoology/mixers/rwkv/v4/wkv_cuda.cu",
+    "upstream/zoology/mixers/rwkv/v4/wkv_op.cpp",
+    "upstream/zoology/mixers/rwkv/v5/wkv5_cuda.cu",
+    "upstream/zoology/mixers/rwkv/v5/wkv5_op.cpp",
+    "upstream/zoology/mixers/rwkv5.py",
+    "upstream/zoology/mixers/rwkv7.py",
+    "upstream/zoology/mixers/scatterbrain/__init__.py",
+    "upstream/zoology/mixers/scatterbrain/attn.py",
+    "upstream/zoology/mixers/scatterbrain/feature_maps_sb.py",
+    "upstream/zoology/mixers/scatterbrain/masking.py",
+    "upstream/zoology/mixers/scatterbrain/projection_utils.py",
+    "upstream/zoology/mixers/scatterbrain/scatterbrain_utils.py",
+    "upstream/zoology/mixers/scatterbrain_new.py",
+    "upstream/zoology/mixers/selective.py",
+    "upstream/zoology/mixers/slide_attn.py",
+    "upstream/zoology/mixers/ttt.py",
+    "upstream/zoology/model.py",
+    "upstream/zoology/train.py",
+    "upstream/zoology/utils.py"
+  ],
+  "scope": "Project source and attributed Apache SISO subset only; upstream/vendor trees omitted. The original complete ZIP is retained locally, NOT redistributed or silently replaced."
+}