Recent comments in /f/MachineLearning
Eaklony t1_jcbfrk2 wrote
Reply to [D] What do people think about OpenAI not releasing its research but benefiting from others’ research? Should google meta enforce its patents against them? by [deleted]
There is a reason why the advanced countries in the world are capitalism countries. Money is mechanism to control long term advancement of pretty much anything in our society. I don’t think anybody should be surprised AI development can’t be forever fully open sourced. Maybe some day it will, but certainly not before some major (global) social reformation.
[deleted] OP t1_jcbfo3n wrote
underPanther t1_jcbf1l8 wrote
Reply to [D] What do people think about OpenAI not releasing its research but benefiting from others’ research? Should google meta enforce its patents against them? by [deleted]
Firstly, I don't see it as research if it's not published. It's a commercial product if they don't share it and profit from it. If you can reimplement it and publish it, it's yours for the taking.
Secondly, there's so much interesting work outside of large language models.
I don't care too much about what OpenAI get up to. They have a management team trying to become billionaires. That's fine. I'm happy doing science in my living room. Different priorities.
[deleted] OP t1_jcbei6j wrote
EnjoyableGamer t1_jcbe3b3 wrote
Reply to [D] What do people think about OpenAI not releasing its research but benefiting from others’ research? Should google meta enforce its patents against them? by [deleted]
There is not much to release from OpenAI, just big model with big data on existing methods. Google Deepmind did go that route of secrecy with AlphaGo, if anything the easy access for anyone to try is cool and new.
In the long run it's their mistake, as research never stops. It won't build on GTP4 but other alternatives that I'm sure will come in the next months.
DigThatData t1_jcbdl00 wrote
Reply to comment by canopey in [D] What do people think about OpenAI not releasing its research but benefiting from others’ research? Should google meta enforce its patents against them? by [deleted]
it started with the GPT-2 non-release for "safety reasons"
DigThatData t1_jcbdeka wrote
Reply to comment by Deep-Station-1746 in [D] What do people think about OpenAI not releasing its research but benefiting from others’ research? Should google meta enforce its patents against them? by [deleted]
i don't see the analogy here, i'm wondering if maybe you're misunderstanding: they have a patent over the technique. not "a dropout", all dropout.
[deleted] OP t1_jcbd87p wrote
CatalyzeX_code_bot t1_jcbcny4 wrote
Reply to [D] Is there an expectation that epochs/learning rates should be kept the same between benchmark experiments? by TheWittyScreenName
Found relevant code at https://github.com/tkipf/gae + all code implementations here
--
To opt out from receiving code links, DM me
Kenyth t1_jcbc5p5 wrote
Reply to comment by xEdwin23x in [D] What do people think about OpenAI not releasing its research but benefiting from others’ research? Should google meta enforce its patents against them? by [deleted]
Baidu is set to announce its latest ChatGPT counterpart tomorrow Beijing time.
NoScallion2450 t1_jcbc23l wrote
Reply to comment by gwern in [D] What do people think about OpenAI not releasing its research but benefiting from others’ research? Should google meta enforce its patents against them? by [deleted]
Discussing a topic does not mean someone is going after someone.
canopey t1_jcbb1cu wrote
Reply to [D] What do people think about OpenAI not releasing its research but benefiting from others’ research? Should google meta enforce its patents against them? by [deleted]
Is there an article or paper where I can read more about this "sudden" pivot from open to private research?
BeautyInUgly t1_jcb88b2 wrote
Reply to comment by NoScallion2450 in [D] What do people think about OpenAI not releasing its research but benefiting from others’ research? Should google meta enforce its patents against them? by [deleted]
peanuts compared to a patent war between Google / MSFT
gwern t1_jcb6nhe wrote
Reply to [D] What do people think about OpenAI not releasing its research but benefiting from others’ research? Should google meta enforce its patents against them? by [deleted]
> I feel it is fair for others to enforce their patents
There are millions upon millions of companies and orgs out there that release less research, and are more parasitic, than OA, many of whom are also making a lot more profits, if that's the problem. Why don't you go after them first, hypocrites? Why do you hate OA for being so much better than the rest?
Caskla t1_jcb6kc8 wrote
Reply to comment by ScientiaEtVeritas in [D] What do people think about OpenAI not releasing its research but benefiting from others’ research? Should google meta enforce its patents against them? by [deleted]
Not sure that ignoring OpenAI is really an option at this point.
The_frozen_one t1_jcb4t0y wrote
Reply to comment by NoScallion2450 in [D] What do people think about OpenAI not releasing its research but benefiting from others’ research? Should google meta enforce its patents against them? by [deleted]
> Well that depends on whether OpenAI can prove Google is deriving commerical value from OpenAI's patented research.
That's not an issue, people make money due to patented technologies all the time. That's different from infringing on a patent. Either way, it would be an incredibly messy battle. Google invented the T in GPT, I can't imagine Google doesn't have a deep AI patent portfolio.
I_will_delete_myself t1_jcb41we wrote
Ernie comrade what happened to the Dalai Lama?
Ernie: ... USA caused a problem
Ernie why is Russia invading Ukraine?
Ernie: USA started the war
Ernie where is Taiwan?
Ernie: Taiwan? It is in the South China Sea owned by all if China. South Korea is also part of China.
PersonifiedAI t1_jcb26j2 wrote
Reply to comment by tiddysiddy in [D] Simple Questions Thread by AutoModerator
Yes :) - you should try out Personified
AMA
I_will_delete_myself t1_jcb193m wrote
Reply to [D] What do people think about OpenAI not releasing its research but benefiting from others’ research? Should google meta enforce its patents against them? by [deleted]
Honestly this is like the movie scene where the hero becomes the villain they once pledge to fight. People have been pulling out because of the direction they are going.
I_will_delete_myself t1_jcb0o9g wrote
Reply to comment by ScientiaEtVeritas in [D] What do people think about OpenAI not releasing its research but benefiting from others’ research? Should google meta enforce its patents against them? by [deleted]
OpenAI naming is like the People's Republic of China. Totally for the people and chosen by the people.
bo_peng OP t1_jcb05e8 wrote
Reply to comment by KerfuffleV2 in [P] ChatRWKV v2 (can run RWKV 14B with 3G VRAM), RWKV pip package, and finetuning to ctx16K by bo_peng
stay tuned :) will fix it
OptimizedGarbage t1_jcazllh wrote
Reply to comment by Deep-Station-1746 in [D] What do people think about OpenAI not releasing its research but benefiting from others’ research? Should google meta enforce its patents against them? by [deleted]
You can sue people who use it for millions of dollars and drive them out of business. Which is exactly how Google uses most of its other patents, as a club to beat competitors with.
haljm t1_jcazfgr wrote
Try more applied fields!
Not in industry (PhD student), but used to do deep learning type research with a computer vision background. I'm now working on applying ML for computer systems. At least 90% of my actual research work is building the system, collecting the data, and deciding how to frame the problem; for that last 10%, essentially anything reasonable will do. The catch is that if you don't have a solid ML background, you might completely miss that last 10% and never realize!
It's much more satisfying since if you're working on applications, you likely have potential downstream use cases lined up (that's what collaborators are for!). You're also probably the only person working on this specific problem formulation, so you don't need to worry about beating SOTA and squeezing out that last 5% -- your data-driven algorithm is 2x better than a traditional approach, so does it really matter?
[deleted] t1_jcaxxmo wrote
Reply to comment by nopainnogain5 in [D] To those of you who quit machine learning, what do you do now? by nopainnogain5
[deleted]
sweatierorc t1_jcbg3ki wrote
Reply to comment by wywywywy in [D] What do people think about OpenAI not releasing its research but benefiting from others’ research? Should google meta enforce its patents against them? by [deleted]
But if they stop publishing, it will hurt adoption, SD1.5 has became the benchmark of txt2img models over dalle-2 or more recent SD models.
Another thing to consider is that not publishing will hurt recruitment. Character.ai founders left google to build their own company after working on Lamda.