• 0 Posts
  • 19 Comments
Joined 2 years ago
cake
Cake day: June 16th, 2023

help-circle
rss

  • Well, OpenAI has clearly scraped everything that is scrap-able on the internet. Copyrights be damned. I haven’t actually used Deep seek very much to make a strong analysis, but I suspect Sam is just mad they got beat at their own game.

    The real innovation that isn’t commonly talked about is the invention of Multihead Latent Attention (MLA), which is what drives the dramatic performance increases in both memory (59x) and computation (6x) efficiency. It’s an absolute game changer and I’m surprised OpenAI has released their own MLA model yet.

    While on the subject of stealing data, I have been of the strong opinion that there is no such thing as copyright when it comes to training data. Humans learn by example and all works are derivative of those that came before, at least to some degree. This, if humans can’t be accused of using copyrighted text to learn how to write, then AI shouldn’t either. Just my hot take that I know is controversial outside of academic circles.


  • Yah, I’m an AI researcher and with the weights released for deep seek anybody can run an enterprise level AI assistant. To run the full model natively, it does require $100k in GPUs, but if one had that hardware it could easily be fine-tuned with something like LoRA for almost any application. Then that model can be distilled and quantized to run on gaming GPUs.

    It’s really not that big of a barrier. Yes, $100k in hardware is, but from a non-profit entity perspective that is peanuts.

    Also adding a vision encoder for images to deep seek would not be theoretically that difficult for the same reason. In fact, I’m working on research right now that finds GPT4o and o1 have similar vision capabilities, implying it’s the same first layer vision encoder and then textual chain of thought tokens are read by subsequent layers. (This is a very recent insight as of last week by my team, so if anyone can disprove that, I would be very interested to know!)




  • Based on the amount of vitriol I’ve personally received on this site for renting one property while I am temporarily relocated to attend school, the answer is yes.

    For some reason everyone views being a landlord as easy money. But in reality returns on investment are worse than the stock market for being the landlord of a single family home.

    Edit: Isn’t it funny how the critics below didn’t even ask questions about a specific situation where it does make sense to rent out an owned home? Instead of trying to understand why someone might make the choice they make, they sling insults and make wide sweeping assumptions to reinforce their skewed world view. Honestly it’s this shit that’s why Trump won. Leftists can’t see the forest for the trees and are willing to engage in ever escalating purity tests that only alienate other sympathetic voters to leftist causes.

    I worked hard to be able to own my own house. Saved money and took out a loan. I never received a penny from my parents or some inheritance from a family member that died. A greater return on investment can absolutely be made by investing in the SP500, returns on investment for single family homes will be worse. The SP500 can be expected to rise an average of 10% per year. A single family home on the other hand will increase by 4.3% per year. With interest rates being higher than that level appreciation, there is effectively no profit from the leverage that can be typically seen by borrowing money. Renting is typically 37% cheaper than buying on a month-to-month basis. Owners don’t expect to Break-even on a home until after 5-10 years of ownership (depending on the city). Over 2/3 the cost of a mortgage go towards loan interest and taxes. Now what does a house get you then if there are all these downsides? Freedom. Freedom to decorate how you choose. To remodel, to build a deck, install Ethernet throughout the house, add an extension. But most of all, it gives long-term stability. After that 5 year period where a homeowner is taking a loss because of buying, they are finally ahead financially of a renter. This is why it doesn’t make sense to sell a home due to short-term circumstances, because owning a home is inherently a long-term benefit. Especially when one loses 10% of the the value of a home selling it when it would take 3 years for the home to even grow to the point where that cost is covered by increases in home value, which is not even remotely guaranteed, as evidenced by home values only increasing 0.12% after falling by 5% the previous year.


  • Ugh… This is all based on Dan Gryder’s YouTube channel. He’s not exactly the most trustworthy person. His channel is full of criticisms of pilots that have died flying that basically amount to “the pilot was dumb” and then when he causes a nearly mutli-fatal accident in a Lockheed 12A because he forgot to lock the tail wheel before landing, he feuds with the YouTuber that pointed this out.

    He constantly derides the FAA and government in general, stating they are incompetent. He has stolen aircraft accident investigation evidence from a crash scene, a violation of federal statute. There’s the defamation lawsuit he lost against a pilot in 2023 to the tune of $1 million. And he was arrested in 2009 at an airport in Georgia.

    Dan Gryder is an attention seeker who will say anything to receive publicity.

    Edit: here’s the analysis on his Lockheed 12A crash: https://youtu.be/sQhA-R2kKbo?si=fWg9EwLirkXwBDOh





  • SLS is on track to be more expensive when adjusted for inflation per moon mission than the Apollo program. It is wildly too expensive, and should be cancelled.

    This coupled with the fact that the rocket is incapable of sending a manned capsule to low earth orbit which is the the lunar gateway is planned to a Rectilinear Halo Orbit instead.

    Those working in the space industry know that SpaceX’s success is not because of Elon but instead Gwynne Shotwell. She is the President and CEO of SpaceX and responsible for all things SpaceX. The best outcome after the election is to remove Elon from the board and revoke his ownership of what is effectively a defense company for political interference in this election. Employees at SpaceX would be happy, the government would be happy, and the American people would be happy.


  • The technical definition of AI in academic settings is any system that can perform a task with relatively decent performance and do so on its own.

    The field of AI is absolutely massive and includes super basic algorithms like Dijsktra’s Algorithm for finding the shortest path in a graph or network, even though a 100% optimal solution is NP-Complete, and does not yet have a solution that is solveable in polynomial time. Instead, AI algorithms use programmed heuristics to approximate optimal solutions, but it’s entirely possible that the path generated is in fact not optimal, which is why your GPS doesn’t always give you the guaranteed shortest path.

    To help distinguish fields of research, we use extra qualifiers to narrow focus such as “classical AI” and “symbolic AI”. Even “Machine Learning” is too ambiguous, as it was originally a statistical process to finds trends in data or “statistical AI”. Ever used excel to find a line of best fit for a graph? That’s “machine learning”.

    Albeit, “statistical AI” does accurately encompass all the AI systems people commonly think about like “neural AI” and “generative AI”. But without getting into more specific qualifiers, “Deep Learning” and “Transformers” are probably the best way to narrow down what most people think of when they here AI today.




  • Agreed.

    Nevertheless, the Federal regulators will have an uphill battle as mentioned in the article.

    Neither “puffery” nor “corporate optimism” counts as fraud, according to US courts, and the DOJ would need to prove that Tesla knew its claims were untrue.

    The big thing they could get Tesla on is the safety record for autosteer. But again there would need to be proof it was known.


  • I am a pilot and this is NOT how autopilot works.

    There is some autoland capabilities in the larger commercial airliners, but autopilot can be as simple as a wing-leveler.

    The waypoints must be programmed by the pilot in the GPS. Altitude is entirely controlled by the pilot, not the plane, except when on a programming instrument approach, and only when it captures the glideslope (so you need to be in the correct general area in 3d space for it to work).

    An autopilot is actually a major hazard to the untrained pilot and has killed many, many untrained pilots as a result.

    Whereas when I get in my Tesla, I use voice commands to say where I want to go and now-a-days, I don’t have to make interventions. Even when it was first released 6 years ago, it still did more than most aircraft autopilots.