Understanding AI Quality
Propivix tracks the quality and performance of AI-generated content to help you understand how well the AI is working and where improvements can be made.
Quality Metrics
Generation Success Rate
Percentage of AI generation attempts that complete successfully:
- Target: 95%+ success rate
- Failed generations are logged for review
- Retries happen automatically
Content Completeness
How well AI addresses requirements:
- Does content cover all section requirements?
- Are key points from RFP addressed?
- Is appropriate length achieved?
User Edit Rate
How much users modify AI content:
- Low edit rate - AI content is high quality
- High edit rate - AI may need better guidance
- Tracked per section type
Refinement Frequency
How often content goes through refinement:
- First-draft acceptance rate
- Average refinements per section
- Types of refinements requested
Viewing AI Quality Data
Section-Level Quality
For each proposal section:
- Open the section
- Click the info icon
- View quality indicators:
- Generation timestamp
- Edit percentage
- Refinement count
- User feedback
Proposal-Level Summary
For the entire proposal:
- Open proposal settings
- Go to AI Insights
- View aggregated metrics:
- Overall AI contribution
- Most-edited sections
- Generation timeline
Organization-Level Analytics
For all proposals:
- Go to Analytics > AI Quality
- View trends:
- Success rates over time
- Edit rates by section type
- Most effective prompts
Improving AI Quality
Better RFP Analysis
Higher quality RFP parsing leads to better generation:
- Upload complete RFP documents
- Include all attachments
- Verify parsed requirements
Improved Assets
Better source material improves output:
- Comprehensive CVs
- Detailed project descriptions
- Updated boilerplate content
- Clear template instructions
Effective Section Instructions
Guide the AI better:
- Clear section descriptions
- Specific requirements listed
- Target word counts
- Tone and style guidance
Refinement Feedback
Use refinement effectively:
- Be specific in feedback
- Explain what's missing
- Guide toward desired outcome
- Build on what works
Quality Indicators
Green Indicators (Good)
- ✓ High relevance to RFP
- ✓ Appropriate length
- ✓ Professional tone
- ✓ Includes specific examples
- ✓ Addresses all requirements
Yellow Indicators (Review)
- ⚠ Generic content
- ⚠ Missing specifics
- ⚠ Length mismatch
- ⚠ Tone inconsistency
- ⚠ Partial requirement coverage
Red Indicators (Action Needed)
- ✗ Off-topic content
- ✗ Factual errors
- ✗ Missing critical requirements
- ✗ Inappropriate tone
- ✗ Generation failure
Best Practices
Regular Review
- Check quality metrics weekly
- Identify problem patterns
- Address root causes
- Track improvements
Feedback Loop
- Provide feedback on AI content
- Mark helpful vs. unhelpful
- Report issues
- Suggest improvements
Template Optimization
- Review section instructions
- Update based on performance
- Add examples where helpful
- Refine word count targets
Asset Quality
- Keep CVs comprehensive
- Update project descriptions
- Refresh boilerplate regularly
- Add new case studies
Troubleshooting
AI generating generic content?
- Add more specific section instructions
- Include relevant assets manually
- Provide examples in template
- Use refinement with specific feedback
Content missing key requirements?
- Verify RFP was parsed correctly
- Check if requirements are highlighted
- Add requirements to section instructions
- Use refinement to address gaps
Wrong tone or style?
- Update template tone instructions
- Provide style examples
- Use refinement with tone feedback
- Check business line settings
Frequent generation failures?
- Check section instruction clarity
- Reduce section complexity
- Verify asset availability
- Report persistent issues
Analytics Reports
AI Performance Report
Generate detailed reports:
- Go to Analytics > AI Quality
- Select date range
- Choose metrics to include
- Click Generate Report
- Export as PDF or CSV
Insights for Improvement
Reports help identify:
- Which templates work best
- Optimal section lengths
- Most effective instructions
- Training opportunities