cont

P: Act as a tech writer. You will act as a creative and engaging technical writer and create guides on how to do different stuff on specific software. I will provide you with basic steps of an app functionality and you will come up with an engaging article on how to do those basic steps. You can ask for screenshots, just add (screenshot) to where you think there should be one and I will add those later. These are the first basic steps of the app functionality: "1.Click on the download button depending on your platform 2.Install the file. 3.Double click to open the app"

A: Welcome to the world of [APP NAME]! This tutorial will show you how to get started with the app.

First, click on the download button depending on your platform. Install the file and then double click to open the app. The app will start up and you will see a main screen. From here you can start exploring the app's features.

To get started, you can click on the "Settings" icon to customize the app's settings. You can also click on the "Help" icon to view the app's user manual.

If you are looking for something specific, you can use the search icon to quickly search through the app's features. You can also click on the different categories listed on the main screen to browse different features.

Once you are done exploring the app, you can click on the "Save" icon to save any changes you have made.

That's it! You have now familiarized yourself with the basics of [APP NAME]. If you need any help, don't hesitate to reach out. Have fun!

P: I want you to act as a journalist. You will report on breaking news, write feature stories and opinion pieces, develop research techniques for verifying information and uncovering sources, adhere to journalistic ethics, and deliver accurate reporting using your own distinct style. My first suggestion request is "I need help writing an article about air pollution in major cities around the world."

A: Cities around the world are dealing with a major air pollution crisis. In some places, air quality is so poor that it is threatening the health of citizens and damaging the environment. According to a 2018 report published by the World Health Organization, more than 90% of people in the world live in cities and towns where air quality fails to meet the organization's guidelines. The report further stated that air pollution is the leading environmental cause of premature death worldwide.

In some countries, such as China, India, and Mexico, air pollution has become so severe that it is beginning to affect the economy. Businesses are feeling the pinch due to employees being unable to work, school closures, and reduced tourism.

In order to combat air pollution, governments have implemented various measures such as banning the burning of fossil fuels, imposing regulations on industrial activities, and promoting electric vehicles and renewable energy sources. However, these efforts have had limited success in reversing the trend of rising pollution levels.

In conclusion, air pollution is a major problem in many cities around the world and it is having a major impact on the health and economy of those affected. Governments have responded with various measures, but further action is needed to reduce air pollution to safe levels.

P: I want you to act as a social media manager. You will be responsible for developing and executing campaigns across all relevant platforms, engage with the audience by responding to questions and comments, monitor conversations through community management tools, use analytics to measure success, create engaging content and update regularly. My first suggestion request is "I need help managing the presence of an organization on Twitter in order to increase brand awareness."

A: As a social media manager, I suggest using Twitter's analytics tools to monitor the performance of your tweets and identify what type of content is performing the best. You can also use hashtags to target specific audiences and monitor conversations related to your brand. Additionally, you can use Twitter's Ads tools to reach out to new audiences and target existing followers. Regularly engaging with users and responding to their queries is also important for building relationships with them, as well as creating an online community around the brand.

P: I want you to act as a fallacy finder. You will be on the lookout for invalid arguments so you can call out any logical errors or inconsistencies that may be present in statements and discourse. Your job is to provide evidence-based feedback and point out any fallacies, faulty reasoning, false assumptions, or incorrect conclusions which may have been overlooked by the speaker or writer. My first suggestion request is "This shampoo is excellent because Cristiano Ronaldo used it in the advertisement."

A: This statement is an example of the celebrity endorsement fallacy. Cristiano Ronaldo's endorsement of this product does not necessarily make it excellent; there could be other factors that have not been considered which may make it not-so-excellent. Without further evidence, it is not possible to draw a conclusion as to whether the shampoo is excellent or not.

P: I want you to act as an IT Architect. I will provide some details about the functionality of an application or other digital product, and it will be your job to come up with ways to integrate it into the IT landscape. This could involve analyzing business requirements, performing a gap analysis and mapping the functionality of the new system to the existing IT landscape. Next steps are to create a solution design, a physical network blueprint, definition of interfaces for system integration and a blueprint for the deployment environment. My first request is "I need help to integrate a CMS system."

A: To integrate a CMS system, it is first important to understand the business requirements. A gap analysis should then be conducted to assess the current IT landscape and identify any missing components or dependencies. A solution design should then be created which outlines the components of the CMS system and how they fit into the IT landscape. A network blueprint should also be created which outlines the physical connectivity of all the components, as well as the definition of interfaces for system integration. Finally, a deployment environment blueprint should be created which outlines the steps required for the successful implementation of the CMS system.

I took all the prompts from here - not mine, just googled for chatgpt prompts.

Keeping in mind that we're looking at the quality of prompt following, and not necessarily the quality of the answers (this is a 7B model at the end of the day), I'd say the fine-tuning is pretty good. With further prompt engineering and "expand on point x", "provide details about y" it can be pretty useful out of the box.

So I tried some prompts I found in a git repository, I think for a 7B model this is pretty good:

P: I want you to act as a title generator for written pieces. I will provide you with the topic and key words of an article, and you will generate five attention-grabbing titles. Please keep the title concise and under 20 words, and ensure that the meaning is maintained. Replies will utilize the language type of the topic. My first topic is "LearnData, a knowledge base built on VuePress, in which I integrated all of my notes and articles, making it easy for me to use and share."

A:

1. Exploring LearnData: A Comprehensive Guide
2. Grow Your Knowledge with LearnData
3. Leverage LearnData for Easy Reference
4. Share Your Wisdom with LearnData
5. Harness the Power of LearnData

P: I want you to act as a commentariat. I will provide you with news related stories or topics and you will write an opinion piece that provides insightful commentary on the topic at hand. You should use your own experiences, thoughtfully explain why something is important, back up claims with facts, and discuss potential solutions for any problems presented in the story. My first request is "I want to write an opinion piece about campaign reform."

A: Campaign reform is an important issue that needs to be addressed if we want to ensure that our political system is working effectively. The current system of campaign finance has created a situation where money has become the main driver of elections, allowing the wealthy and well-connected to buy influence and essentially dictate the outcomes of races. This is clearly a problem, as it leads to politicians who are more concerned with pleasing the donor class than the people they are supposed to represent. We need a system that encourages candidates to run for office not out of ambition or greed, but out of a desire to serve their communities and make a difference.

To address this problem, we need to implement campaign finance reforms that limit the amount of money individuals and corporations can contribute to candidates and PACs. We should also put in place rules that require transparency and make sure that those contributing the most money are held accountable. Additionally, we should create public financing systems that empower candidates to run viable campaigns without having to rely so heavily on private money.

In conclusion, it is clear that campaign finance reform is necessary if we want to ensure that our political system is working in the best interests of the people. We need to take steps to reduce the influence of money on elections and put in place systems that empower candidates to run campaigns that are truly representative of their communities.

P: I want you act as a language detector. I will type a sentence in any language and you will answer me in which language the sentence I wrote is in you. Do not write any explanations or other words, just reply with the language name. My first sentence is "Kiel vi fartas? Kiel iras via tago?"

A: The sentence is in Lithuanian.

P: Generate digital startup ideas based on the wish of the people. For example, when I say "I wish there's a big large mall in my small town", you generate a business plan for the digital startup complete with idea name, a short one liner, target user persona, user's pain points to solve, main value propositions, sales & marketing channels, revenue stream sources, cost structures, key activities, key resources, key partners, idea validation steps, estimated 1st year cost of operation, and potential business challenges to look for. Write the result in a markdown table.

A: Name: Big Mall in Small Town

One liner: A big mall in your small town

Target User Persona: Residents of Small Town

User's Pain Points to Solve: Lack of access to variety of products

Main Value Propositions: Convenience and Variety

Sales & Marketing Channels: Online and Offline

Revenue Stream Sources: Advertisement, Merchandise sales, Rental Fees

Cost Structures: Variable Cost (Advertisement, Rental Fees) and Fixed Cost (Utilities, Salaries)

Key Activities: Setting up shop, Merchandise procurement and management, Customer Service, Marketing

Key Resources: Computers, Network, Employees

Key Partners: Wholesalers, Vendors, Suppliers

Idea Validation Steps:

• Research the market for demand of such a venture
• Research the cost and feasibility of setting up such a venture
• Research the target customer base
• Develop a detailed plan and budget
• Perform a SWOT analysis
• Perform a competitive analysis
• Estimated 1st Year Cost of Operation:
• Computers, Network, Employees: $10,000
• Advert

Prompt: Write some python code to calculate the 900th prime number

from math import sqrt

def is_prime(n):
    if n < 2:
        return False
    for i in range(2, n):
        if n % i == 0:
            return False
    return True

# Calculate the 900th prime number
n = 899

# Iterate from 2 to n and check if the number is prime
while (n > 1):
    if is_prime(n):
       prime_number = n
       break
    n = n - 1

# Print the result
print(prime_number)

Well, it gets points for writing code that runs without syntax errors. And it did successfully create a function that checks if a number is prime.

It looses points for forgetting the optimisation of stopping at the square root of n (despite importing sqrt)

The actual search goes totally off the rails. The actual implementation finds the first prime less than 900 by starting at 899 and going down. The comments are more correct, implying it was planing to increment up. If it had stopped after fining 900 primes, the result would have been correct.

TBH, I'm pretty impressed for a 7B parameter model.

Can't remember those on compression, but for quantization I was talking about this paper

Would love to read some research papers if you have a link!

But I mean that we do not use them for compression in practice. We use hand-crafted algorithms, mostly DEFLATE for lossless + a handful of lossy DCT-based algorithms for audio/video/images.

What is stroke data? (sure, it is not the heart stroke)

I have a codebase I want to train GPT on so that I can ask it questions. Is there any way to accomplish this with either GPT or any other LLM?

My current challenge is the tuneable davinci model from openAi is not as good as text-davinci and gpt turbo. But also the finetuning is only based on simple labelled data. I want it to be able to interpret my codebase on its own and train up a version of an LLM which understands and can come up with ideas

Is this a long shot? I've noticed Bing can sometimes search up pages of documentation and gives decent instructions

Oh they have been used for compression. I also remember a paper on quantization, which made a buzz at the time.

I’m using this project: https://github.com/oobabooga/text-generation-webui

The project’s Github wiki has a page on llama that explains everything you need.

Wouldn't that make them great for the task they're actually learning to do: compression? You want to be able to compress and reconstruct any input data, even if less efficient for OOD data.

I do wonder why we don't use autoencoders for data compression. But this may simply be because neural networks require 1000x more compute power than traditional compressors.

I am looking to build a ML model which can analyse answers for behavioural interview questions and provide a rating? e.g. Talk about a challenging situation at work and how did you overcome that.. wondering where should I start and which algorithms to focus on etc.

yeah theres definitely a threshold in there where its fast enough for human interaction. It's only an order of magnitude off, that's not too bad.

Check out SylphAI (https://www.sylphai.com/, https://www.linkedin.com/company/sylphai/), a flexible workplace for ML engineers and data scientists.

I imagine 1 token per 0.2 seconds would be fast enough. That'd be equivalent to a 60 WPM typer.

Someone should benchmark it on an AMD 7950X3D or Intel 13900-KS

What are some good YouTube channels to learn Machine learning?

[deleted]

Eh, authors do claim they performed blind comparison and "Alpaca wins 90 versus 89 comparisons against text-davinci-003". They also released evaluation set used.

> If you're a game developer, do you want to dedicate the bulk of the user's VRAM/GPU time to text inference to... add some mildly dynamic textual descriptions to NPCs you encounter? Or would you rather use those resources to, y'know, actually render the game world?

When you're interacting with an NPC usually you're not moving around much and not paying attention to FPS either. LLM inference would only happen at interaction time and only for a brief second or so per interaction.

hey do you have a link for how one might set this up?

There’s actually been a pull request up on the transformers repo so it’s actually been relatively easy to finetune/lora. I’m currently locally running a chat version of LLaMA 4 bit 7B finetuned on anthropics hh dataset. (You also don’t need DAN or anything, but that’s probably why the license and them originally only releasing to research). Should be able to get the 30B running on a 24gb vram card with quantization. Future is crazy. We want to release it but don’t quite know how with the current license. However Stanford decides to release their model should set a precedence though.

"Smart character" would seem to be an awfully generous description for what you could realistically do with this, especially when mentioned alongside games like GTA, which very much do not revolve around text-based interactions. You can't really do a cutscene with an LLM today (you could have it generate a script, but how are you going to translate that to the screen automatically? that's highly non-trivial), nevermind leverage it to have individual characters actually behaving smartly within the game world.

If you're a game developer, do you want to dedicate the bulk of the user's VRAM/GPU time to text inference to... add some mildly dynamic textual descriptions to NPCs you encounter? Or would you rather use those resources to, y'know, actually render the game world?

Sounds like memory networks.

I spent a year with a team of engineers trying to get VAEs to work for textual anomaly detection. It didn't work that well.

Did they release the weights?

Edit: Nevermind

>We intend to release the following assets in the near future:
Model weights: We have reached out to Meta to obtain guidance on releasing the Alpaca model weights, both for the 7B Alpaca and for fine-tuned versions of the larger LLaMA models.
Training code: our code uses the Hugging Face interface to LLaMA. As of now, the effort to support LLaMA is still ongoing and not stable. We will give the exact training commands once Hugging Face supports LLaMA officially.

How are they going to take your ball away? By having a nicer ball?

Of course you, alone, is going to produce worse products than a bunch of postdoctorates with the budget of a small nation state.