4o-mini Realtime -> Reducing cost, providing KB
Hi, I'm curious on how to optimize usage of the mini-realtime model. Using transient assistant via Make.com.
I'm trying to minimize cost and find a solution for KBs.
1) Since with a longer prompt it gets expensive quite quickly.. Can we "outsource" the prompt? For example that it pulls the prompt via Make.com from a Google Doc? Would that reduce cost?
2) What do you guys recommend as a solution for KBs? Same approach as in point 1, that it just pulls the KB from a Google Doc/Airtable/etc?
Thx guys appreciate any input
I'm trying to minimize cost and find a solution for KBs.
1) Since with a longer prompt it gets expensive quite quickly.. Can we "outsource" the prompt? For example that it pulls the prompt via Make.com from a Google Doc? Would that reduce cost?
2) What do you guys recommend as a solution for KBs? Same approach as in point 1, that it just pulls the KB from a Google Doc/Airtable/etc?
Thx guys appreciate any input