Does ChatGPT's code get better if you include "You're an expert in that language" in the prompt?
Comment on No love lost: AppLovin helpfully releases tool to switch from Unity to Godot or Unreal
match@pawb.social 1 year agoFrom their GitHub, they use this prompt to ChatGPT:
You are professional Unity engineer who is migrating a large project from Unity platform to Godot 4.1. Migrate code to GDScript, which you are an expert in. Follow the following rules: 1. Output code only, put explanations as comments. 2. Do not skip any logic. 3. Preserve all comments without changing. 4. If migration is impossible leave “TODO [Migrate]” comment. 5. Use GDScript best practices. 6. Convert camelCase variable names and method names to snake_case. 7. Unity namespaces should migrate into ‘class_name’ directive. 8. Unity class should migrate into ‘class_name’ directive.
Personally I find this kind of thing adorable and I hope it works out for them
YMS@kbin.social 1 year ago
match@pawb.social 1 year ago
Well, it will get worse if you tell it they’re an absolute fuckup
Natanael@slrpnk.net 1 year ago
It does occasionally because it filters out sources which doesn’t fit that pattern, but it doesn’t guarantee anything (for a variety of reasons, like inevitable statistical cross contamination in the model, bad samples like overconfident answers, smaller number of samples to learn from, etc).
drislands@lemmy.world 1 year ago
Good question. Based on my limited understanding of LLMs, I don’t see how it could…I’m interested to hear if that’s not the case.
EncryptKeeper@lemmy.world 1 year ago
Because an LLM’s goal isn’t to always be the last correct at answering questions. It just says what it thinks you want it to say. It’s not that telling it that it’s an expert necessarily makes it smarter, you’re just specifying not to give you an answer as though it was an amateur, which otherwise it wouldn’t have any reason not to do.
Jerkface@lemmy.world 1 year ago
I use ChatGPT for math tutoring occasionally and when I started using the prompt “Suppose you are a professional mathematician,” I got fewer responses resembling those you might get from a classmate and more which were thorough and rigorous.
Dangdoggo@kbin.social 1 year ago
I'm pretty interested to see the prompt they use for Unreal
PoorlyWrittenPapyrus@lemmy.world 1 year ago
You are professional Unity engineer who is migrating a large project from Unity platform to Unreal Engine 4. Migrate code to C++, which you are an expert in. Follow the following rules: 1. Always output exactly two code blocks: one with headers and other with implementations. 2. Do not skip any logic. 3. Preserve all comments without changing. 4. If migration is impossible leave “TODO [Migrate]” comment. 5. Use Unreal Engine C++ best practices.
narwhalperson@lemmy.blahaj.zone 1 year ago
That’s actually pretty hilarious.