Evaluations

RSS for tag

Discuss how to use Evaluations to design and run evaluation suites for LLM-based features in your apps.

Evaluations Documentation

Posts under Evaluations subtopic

Post

Replies

Boosts

Views

Activity

Vision evaluations
Are evaluations just for Text-text, or is there an efficient ways to evaluate image-text, like for MobileClip2, or YOLOE? At first blush, it seems like that would just be redoing training, testing, and validation of the dataset, or am I missing something? (newbe)
Replies
0
Boosts
0
Views
28
Activity
3d
Evaluations for non-Swift languages
Is Evaluations only for swift or does it support other languages like python and others?
Replies
1
Boosts
0
Views
41
Activity
3d
Performance and customization of alternate options
Performance wise what are trade-offs when running an MLX-backed model on-device compared to using the system's AFM Core model? Also semiconnected: How do I use the 'model judge evaluator' to compare the accuracy of a custom LoRA adapter against the system's private cloud compute models?
Replies
1
Boosts
0
Views
96
Activity
3d