fix(aggregator): make IPFS uploads resilient to a large MFS directory

[jpraynaud]

Content

This PR includes fixes for the IPFS upload of immutable archives failing with operation timed out on a network with a large MFS directory:

• List the MFS directory entries without their nodes: the long listing made Kubo load every child node from the datastore while only the entry names are used to skip already uploaded archives.
• Raise the default Kubo RPC query timeout from 1 to 10 seconds, which covers the files/stat and files/mkdir queries on a sharded directory right after a batch of uploads.
• Retry the directory CID query in batch uploads with the uploader retry policy, so a single slow answer no longer discards a batch whose uploads all succeeded.

The original error received was:

Failed to upload immutable archive

Failed to send request to Kubo RPC endpoint: 'api/v0/files/stat'

Caused by:
    0: error sending request for url (http://ipfs-node-aggregator:5001/api/v0/files/stat?arg=%2Fmithril%2F)
    1: operation timed out

Pre-submit checklist

• Branch
  • Tests are provided (if possible)
  • Crates versions are updated (if relevant)
  • Commit sequence broadly makes sense
  • Key commits have useful messages
• PR
  • All check jobs of the CI have succeeded
  • Self-reviewed the diff
  • Useful pull request description
  • Reviewer requested

[Copilot]

🟡 Changes recommended

Directory CID retry errors should use operation-appropriate context before approval.

Get a fresh assessment by requesting another Copilot review.

Pull request overview

Improves aggregator IPFS uploads for large MFS directories by reducing listing overhead, increasing RPC timeouts, and retrying directory CID lookups.

Changes:

• Lists MFS entries by name without loading child nodes.
• Raises the default Kubo RPC timeout to 10 seconds.
• Retries directory CID retrieval and updates fixtures and package versions.

File summaries

File	Summary
mithril-aggregator/src/tools/kubo_rpc_client/query/ipfs_files_ls.rs	Optimizes MFS directory listings.
mithril-aggregator/src/tools/kubo_rpc_client/api.rs	Increases the default RPC timeout.
mithril-aggregator/src/file_uploaders/ipfs_uploader.rs	Adds directory CID retries; retry errors need operation-appropriate context.
mithril-aggregator/src/artifact_builder/cardano_database_artifacts/immutable.rs	Updates IPFS uploader test fixtures.
mithril-aggregator/Cargo.toml	Bumps the aggregator version.
Cargo.lock	Synchronizes the locked version.

Review details

• Files reviewed: 5/6 changed files
• Comments generated: 1
• Review effort level: Lite

---

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

[github-actions]

Test Results

     5 files  ±0     221 suites  ±0   1h 0m 27s ⏱️ - 4m 36s
 3 627 tests +2   3 627 ✅ +2  0 💤 ±0  0 ❌ ±0 
11 765 runs  +6  11 765 ✅ +6  0 💤 ±0  0 ❌ ±0 

Results for commit 6afbd8b. ± Comparison against base commit 4afa36e.

♻️ This comment has been updated with latest results.