BiliCore Released as Open Source on GitHub

BiliCore — the open-source framework that powers Bili — is now publicly available on GitHub at github.com/msu-denver/bili-core.

BiliCore is a configurable framework for evaluating large language model behavior, security, and performance across providers. It supports comparing models from AWS Bedrock, Google Vertex AI, Azure OpenAI, OpenAI, and local backends using standardized benchmarks, and underpins the lab’s broader work on LLM evaluation including AETHER (multi-agent ecosystems) and AEGIS (adversarial security testing).

The release makes the lab’s evaluation tooling available to other researchers and educators working on domain-specific LLM applications — from sustainability and education to civic technology and beyond. Development was supported by the NSF-funded Sustainability Hub project (Award #2318730) and NAIRR Pilot cloud resources (Allocation NAIRR240197).