I am struggling with my requirement and need some help. I want the gpt to score texts(articles) based on various attributes like grammar, relevance, structure and so on out of 100 each. I started testing with set of rules on the gpt4 UI and api. I quickly realized the answers getting from both sources differ and also individually they are different when asked repeatedly even with the same data/question.
I am not sure what would be the best path forward or the solution for this. I was thinking of fine tuning but have no prior experience in AI or similar. Is fine tuning hard or can be executed in short period of time? How well it works with say short data? Like if i pass 100 articles. Will it still be somewhat better than the existing api results?
Can someone also explain with an example how much it would cost to test on such a sample data? Like I did read about. Pricing but not sure I understood if computational cost is included and are there any other costs associated with it.
Gpt responses sometimes are really weird. For example for a good article it might rate average and then I edited the same article to make it short and bad but still it rated it the same or high in some attributes.
Also would like to know is there any other way to achieve this currently? Thanks for the help!!
