You certainly strongly implied that NDAs don't apply with the phrase "their magically novel, super unique code is just too secret". You used the words "is just too secret" sarcastically, which led me to believe you think in fact the work is not too secret to exfiltrate to the LLMs on the Internet: that is, that NDAs don't apply.
> In reality a programmer could yield immense value from such tools having a) given it zero lines of their code, b) used zero lines of the code it generated.
We simply have different experiences of life! I think with the advent of Claude 3.5 Sonnet the LLMs have just about edged out ahead in terms of time saved vs time wasted, for me, but before Sonnet I'm fairly confident they were moderately net negative for me.
Can you give some concrete examples of where they've helped you this dramatically? With links to chat logs? I still don't understand how people are finding them so useful, and I keep asking people and they keep not providing chat logs so I can see what they're doing.
I did not imply that. I implied that people who have projects for whom these tools are purportedly useless can never tell you anything about the project even remotely because it makes it impossible to note that it, like most projects is likely overwhelmingly well-trodden ground with a mild remix. Loads and loads of super proprietary projects working in very unique domain spaces have code that is overwhelmingly common with very different domains and spaces. Medical, financial, ballistic, gaming, data, etc -- loads and loads of the code we build for these domains is common.
If someone can't use these tools for security or propriety reasons, that's an obvious hard restriction. But saying "oh my code is just too unique, my skills too advanced" is self-deluding nonsense.
>I think with the advent of Claude 3.5 Sonnet the LLMs
We are talking about now. The present. I'm stating the value of these tools now. Their state in the past is irrelevant.
If you want something concrete: I have never yet seen any even slightly competent code come out of an LLM when it's writing in F#, Mathematica, or POSIX sh, which are broadly the languages I write in. (It's possible Wolfram's very new LLM does better on Mathematica because it's been trained on it specifically, but I haven't tried it.) I've only had Sonnet for a day (having been burned too many times by other LLMs, but decided yesterday it was time to try again), so am not in a great position to comment on Sonnet's abilities with those languages specifically. My preliminary guess is that we've gone from 4o's "20% correct" to Sonnet's "50% correct".
> Their state in the past is irrelevant.
Apparently also their state in the present? I said "just about edged out ahead", whereas you say "immense value".
I find a number of models fantastically useful in the present. I'm not sure why your one day evaluation of them is relevant to how I utilize them.
It was inevitable that someone was going to do the "but I insist upon writing in some fringe language" bit (when the "my project and domain is too unique" bit faltered), but many models actually have excellent F# abilities. Eh.
I'm not sure why your use of them is relevant to how I can use them; resolving that question is why I asked you for chat logs! I genuinely want to make these things work! I try again every few months in case anything has changed, and I keep asking people how they're getting value so that I can also get value, and nobody ever tells me!
> many models actually have excellent F# abilities
Name three? As I said, I badly want this stuff to work!
Claude has been pretty good at F# so far. Sometimes it makes mistakes as if it was OCaml but other than that I found the output actually better than C#. That is - the C# output has higher likelihood of being correct, but because there is so much absolutely terrible code out there - you have to coerce it to give you good output, which you don't need to do with F#.
And of course Github Copilot autocomplete works well just as it does for most other languages.
> In reality a programmer could yield immense value from such tools having a) given it zero lines of their code, b) used zero lines of the code it generated.
We simply have different experiences of life! I think with the advent of Claude 3.5 Sonnet the LLMs have just about edged out ahead in terms of time saved vs time wasted, for me, but before Sonnet I'm fairly confident they were moderately net negative for me.
Can you give some concrete examples of where they've helped you this dramatically? With links to chat logs? I still don't understand how people are finding them so useful, and I keep asking people and they keep not providing chat logs so I can see what they're doing.