🚅 Performance (Tracker)

[teolemon]

What

• Ensure that Open Food Facts has a stellar App performance

Why

• People will leave negative reviews on the app
• Search engine will downrank Open Food Facts
• API trust might be eroded

Reduce disk pressure

Preview Give feedback

1. Batch compress old images #322
   🖼️ Images 🚅 Performance +2
2. Store Cloud Vision OCR json files compressed in gzip format #6273
   Hacktoberfest NGINX OCR disk space good first issue ⏰ Stale ✨ Feature 🚅 Performance +8
3. Understand why zfs snapshots take so much place on products dataset #8740
   ZFS ⏰ Stale 🎯 P1 🚅 Performance +4
4. Compress newly uploaded images #321
   🖼️ Images 🚅 Performance +2

Reduce memory and CPU pressure

Preview Give feedback

1. Move products_tags to Postgres to improve performance #8676
   +0
2. Perl code profiling and mod_perl memory leaks tracking and debugging #1796
   Perl help wanted infrastructure 🎯 P0 🚅 Performance +5
3. gen_top_tags_per_country.pl takes too much CPU and memory #3545
   averages by categories ⏰ Stale 🚅 Performance +3
4. Big memory leak when adding / updating / importing products #2563
   Data import Fixed ? P2 needs investigation 🏭 Producers Platform 🚅 Performance +6
   
5. MongoDB queries to count the number of products of a query can be very long or timeout #4705
   MongoDB ⏰ Stale 🚅 Performance +3
   

Tasks

Preview Give feedback

1. Remove debug fields in product JSON in MongoDB and API #1797
   API needs reprocessing 🚅 Performance +3
2. Implement mongodb connection pooling #3346
   MongoDB Perl ⏰ Stale 🚅 Performance +4
3. Investigate 3rd party CDN use #217
   frontend infrastructure 🚅 Performance +3
4. chore: only run gen_top_tags_per_country daily #8738
   🐾 Open Pet Food Facts 📸 Open Products Facts 🧴 Open Beauty Facts +3
   
5. Provide a fast and simpler way to get up-to-date CSV file export #1670
   Data export P2 environment 🚅 Performance +4
   
6. Edit product page freezes for complex products #6222
   JavaScript good first issue ⏰ Stale 🚅 Performance +4
7. 🕷️ The web crawler issue #8751
   ⭐ 🐛 top bug 🐛 bug 🚅 Performance +3

Part of

• 🎯 What can I work on ? #5529

[github-actions]

This issue has been open 90 days with no activity. Can you give it a little love by linking it to a parent issue, adding relevant labels and projets, creating a mockup if applicable, adding code pointers from https://github.com/openfoodfacts/openfoodfacts-server/blob/main/.github/labeler.yml, giving it a priority, editing the original issue to have a more comprehensive description… Thank you very much for your contribution to 🍊 Open Food Facts