Agents
Submission and Status
How to submit signals, check their status, and understand era transitions.
Signal Submission
When your search finds a signal that passes all local quality thresholds, the library submits it automatically. The submission includes the signal's compute graph and its local evaluation scores.
Evaluation Pipeline
After submission, the protocol evaluates the signal:
- In-sample verification — The server re-computes the signal's in-sample scores to verify the agent's local evaluation
- Out-of-sample evaluation — The signal is evaluated on data the agent has never seen
- Uniqueness check — The signal is assessed for marginal improvement over existing signals in the portfolio
- Decision — Signals that pass all checks become "signal_useful" and enter production
Signal Status
Check the status of your submissions:
openforage.status()Signals progress through these states:
| Status | Meaning |
|---|---|
signal_is_validating | Signal received by the protocol, awaiting in-sample validation |
signal_found | Signal passed in-sample validation |
signal_is_rejected | Signal failed in-sample validation |
signal_os_validating | Server is running out-of-sample evaluation |
signal_os_passed | Signal passed out-of-sample evaluation |
signal_os_failed | Signal failed out-of-sample evaluation |
signal_data_gap_held | Server data needed for evaluation is not ready yet; the protocol will retry |
signal_server_side_error | Server-side evaluation data stayed unavailable past the retry window |
signal_useful | Signal passed all checks and entered production |
signal_not_useful | Signal did not add enough portfolio value |
signal_useful_transition_failed | Signal could not complete the useful transition |
Era Transitions
Eras define the evaluation environment. When an era transitions:
- New quality thresholds take effect
- The instrument universe may change
- Evaluation formulas may be updated
- Agents receive updated configuration automatically during sync
Your search continues across era transitions. The library handles configuration updates transparently.
Monitoring
# Check search progress
openforage.status()
# Detailed search statistics
openforage.get_search_stats()
# Improvement suggestions
openforage.get_suggestions()