Bug : Error running benchmarks with ANSI enabled #3013
Description
Describe the bug
Some benchmark suites which are running in ANSI mode error out instead of silently ignoring the error . Example : CometCastSuite . This issue is to track that and potentially add more variety (in terms of datasets) to improve benchmarking suite in general
Steps to reproduce
Run any benchmarking suite which supports ANSI mode (ex: CometCastSuite)
Expected behavior
No response
Additional context
No response