> ## Documentation Index
> Fetch the complete documentation index at: https://labs.laer.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Classification Models

You can create models that can be applied to your data for various purposes, including classification and information extraction. We will walk you through the process of creating, training, and running your AI models, as well as understanding the predictions and metrics reports generated.

<Frame>
  <img src="https://mintcdn.com/epiqai/5-Xpsc0dxL4Alr7A/images/create_models.png?fit=max&auto=format&n=5-Xpsc0dxL4Alr7A&q=85&s=29ed270e754dc1cc6bb7a93790616cf1" alt="" width="2196" height="1438" data-path="images/create_models.png" />
</Frame>

## Create a model

* **Instruction-based Creation**: Define your model by providing a set of instructions that describe the desired outcomes and functionalities.
* **Example-based Training**: Alternatively, you can train your model by feeding it examples. Upload your data samples or tag documents that are already in Epiq AI and the system will learn to recognize patterns and make predictions.

<Frame>
  <img src="https://mintcdn.com/epiqai/5-Xpsc0dxL4Alr7A/images/model_instructions-1.png?fit=max&auto=format&n=5-Xpsc0dxL4Alr7A&q=85&s=f970407f560870528b348459f8e375e1" alt="" width="2340" height="1352" data-path="images/model_instructions-1.png" />
</Frame>

### **Training Your Model**

* **Training Process**: Initiate the training process by selecting 'Run'. You can monitor the training progress in real-time.
* **Feedback Loop**: Provide feedback on the model's performance iteratively during training to enhance accuracy.

<Frame>
  <img src="https://mintcdn.com/epiqai/PTrKqfq7PLU1AcXh/images/save_models.png?fit=max&auto=format&n=PTrKqfq7PLU1AcXh&q=85&s=e89ca38b2e162474a0a5033a962e53c2" alt="" width="2366" height="442" data-path="images/save_models.png" />
</Frame>

### **Model Predictions**

Once the model is run, you will receive predictions based on your data. The predictions will include confidence scores as well as predicted tags or extractions.

<Frame>
  <img src="https://mintcdn.com/epiqai/5-Xpsc0dxL4Alr7A/images/model_predictions.png?fit=max&auto=format&n=5-Xpsc0dxL4Alr7A&q=85&s=21337128c1708766904d139874b79e03" alt="" width="2178" height="1334" data-path="images/model_predictions.png" />
</Frame>

## Metrics Report

The metrics report helps you measure model performance after a run.

Use it to review core metrics such as accuracy, precision, and recall.

These metrics help you understand how well the model is performing on your data.

<Frame>
  <img src="https://mintcdn.com/epiqai/5-Xpsc0dxL4Alr7A/images/image-37.png?fit=max&auto=format&n=5-Xpsc0dxL4Alr7A&q=85&s=4dd49ac2fea64df695eee53953e29dac" alt="" width="3244" height="1672" data-path="images/image-37.png" />
</Frame>

Alongside predictions, a comprehensive metrics report is generated. This includes accuracy, precision, recall, and other relevant statistics.

<Frame>
  <img src="https://mintcdn.com/epiqai/5-Xpsc0dxL4Alr7A/images/image-38.png?fit=max&auto=format&n=5-Xpsc0dxL4Alr7A&q=85&s=f1b6895766821077c91c4928e7d68dc7" alt="" width="3386" height="1750" data-path="images/image-38.png" />
</Frame>

## Model Analytics

Model Analytics lets you run evaluations on AIDA predictions (AIDA Model Prediction with scores or AIDA LLM Prediction). The judge could be Human Label or another LLM.

You can use these evaluations to compare predictions and review the result for each item.

If you use the **LLM as Judge** evaluation type, an LLM acts as the judge and evaluates the predictions. After the evaluation finishes, you can see a **Pass** or **Fail** result and the reason for the decision.

For other evaluation types, the results show only **Pass** or **Fail**.

### Use Model Analytics

1. Open the model you want to evaluate.
2. Go to **Analytics**.
3. Select the prediction type you want to compare.
4. Select the judge type.
   * Use **Human Label** to compare predictions against reviewed labels.
   * Use **LLM as Judge** to have an LLM evaluate the prediction.
5. Run the evaluation.
6. Review the results for each item.
   * **LLM as Judge** shows **Pass** or **Fail** and a reason.
   * Other evaluation types show **Pass** or **Fail** only.

<Frame>
  <img src="https://mintcdn.com/epiqai/5-Xpsc0dxL4Alr7A/images/image-35.png?fit=max&auto=format&n=5-Xpsc0dxL4Alr7A&q=85&s=1b48ff3310fd912c1ef545c558cee7d6" alt="" width="3310" height="1458" data-path="images/image-35.png" />
</Frame>

<Frame>
  <img src="https://mintcdn.com/epiqai/5-Xpsc0dxL4Alr7A/images/image-36.png?fit=max&auto=format&n=5-Xpsc0dxL4Alr7A&q=85&s=8ff0408559f6cffae9d8c0ae94463bb7" alt="" width="3294" height="1596" data-path="images/image-36.png" />
</Frame>

<Frame>
  <img src="https://mintcdn.com/epiqai/nS5UcVIcNVyp4Qxh/images/Model-Analytics.png?fit=max&auto=format&n=nS5UcVIcNVyp4Qxh&q=85&s=ad71877ac1eda339e912b9027f191408" alt="" width="2514" height="1442" data-path="images/Model-Analytics.png" />
</Frame>

<Frame>
  <img src="https://mintcdn.com/epiqai/5-Xpsc0dxL4Alr7A/images/image.png?fit=max&auto=format&n=5-Xpsc0dxL4Alr7A&q=85&s=d908975f234ea589529e548955fabdfb" alt="" width="3320" height="1382" data-path="images/image.png" />
</Frame>

<Frame>
  <img src="https://mintcdn.com/epiqai/5-Xpsc0dxL4Alr7A/images/image-1.png?fit=max&auto=format&n=5-Xpsc0dxL4Alr7A&q=85&s=69e1af42e8df359a4453bc4722b85c2d" alt="" width="3312" height="1432" data-path="images/image-1.png" />
</Frame>

## Tag Prediction Report

The tag prediction report shows which tags the selected models predicted.

Use this report to review predicted tags, apply constraints, and download the results.

<Frame>
  <img src="https://mintcdn.com/epiqai/5-Xpsc0dxL4Alr7A/images/image-2.png?fit=max&auto=format&n=5-Xpsc0dxL4Alr7A&q=85&s=4459bd013aad9b3ae658542dd3a9c30a" alt="" width="3328" height="678" data-path="images/image-2.png" />
</Frame>

### Create a tag prediction report

1. Select the models you want to include in the report.
2. Click **Create Report**.
3. Adjust the predicted tags, labeled data setting, and threshold.
4. Continue to **Constraints**.

<Frame>
  <img src="https://mintcdn.com/epiqai/5-Xpsc0dxL4Alr7A/images/image-3.png?fit=max&auto=format&n=5-Xpsc0dxL4Alr7A&q=85&s=886fbd30531951fc3b5b18bb4239fe18" alt="" width="3760" height="498" data-path="images/image-3.png" />
</Frame>

5. Enter a name for the report.
6. Add any constraints you need.
   * For example, if **Topic 301** applies, **Topic 302** must also apply.
7. Validate the constraints.
8. Click **Create**.

<Frame>
  <img src="https://mintcdn.com/epiqai/5-Xpsc0dxL4Alr7A/images/image-5.png?fit=max&auto=format&n=5-Xpsc0dxL4Alr7A&q=85&s=7b0e7b61fa8375777e290d3d28ee1fc3" alt="" width="2098" height="708" data-path="images/image-5.png" />
</Frame>

### View and download reports

Generated reports appear on the **Reports** page.

Open a report to review the results or download the output.

<Frame>
  <img src="https://mintcdn.com/epiqai/5-Xpsc0dxL4Alr7A/images/image-6.png?fit=max&auto=format&n=5-Xpsc0dxL4Alr7A&q=85&s=5360f290510c592cf02c3a787b07b24c" alt="" width="3318" height="1038" data-path="images/image-6.png" />
</Frame>

<Frame>
  <img src="https://mintcdn.com/epiqai/5-Xpsc0dxL4Alr7A/images/image-8.png?fit=max&auto=format&n=5-Xpsc0dxL4Alr7A&q=85&s=6b9174ea141d07f87e7b401f5d230061" alt="" width="3316" height="1690" data-path="images/image-8.png" />
</Frame>
