AI Agent: Reporting Assistant
In many industries, as part of a highly performing Quality Assurance and Customer Support functions,
reporting unusual events, anomalies, or process deviations requires clear, structured documentation that
captures the full context: what happened, when, where, who was involved, why it occurred, and what actions were taken…
This project proposes the development of an assistant generates a well-written, standardized report based on the input.
Here some of the tasks carried out:
Data creation: generate a data set of reports to use them as ground truth (reference) to train the model. This was made by automating prompts through an API.
Model selection and experimentation plan : Test different Hugging Face models to evaluate its performance. Play with the generation parameters (temperature, top_k, top_p, presence_penalty, etc) and compare the results
Evaluation metrics : Text-to-text comparison, through tokenization and the attention mechanism: Bert score, bleu/rouge score, cross encoder similarity...
Model training : Using QLoRa and a SFT strategy on a small model (less than 1 billion parameters) in order to specialize it in the reporting task
Web application interface to ease accesibility and the report download