HackerNews Summary (2023-06-08 02PM)

Source: Understanding GPT tokenizers

Summary
Understanding GPT tokenizers is an important aspect of building large language models. With OpenAI’s Tokenizer tool and third-party tools like Simon Willison’s Observable notebook, users can convert text to integers and search for tokens quickly. Capitalization of words is crucial to the tokenization process, and many words incorporate a leading space for more efficient tokenization of full sentences. In some cases, usernames from sites like Reddit can end up getting their own token.

Fact

🔍 Glitch tokens such as “david” (token 23282) are intriguing anomalies in tokenization that are near the centroid of the token embedding space. These tokens sometimes break things when the model cannot differentiate between intertwined usernames and words.

🌎 Languages other than English often have less efficient tokenization when encoded, such as Spanish’s “El perro come las manzanas,” which gets low token ID numbers for English words and higher token ID numbers for non-English words or character sets.

🔠 Most common English words are assigned single tokens that incorporate leading spaces, making for more efficient encoding of full sentences.

---

Source: Atoms Is Hiring Marketng Lead

Summary
Atoms is seeking a Marketing Lead to own the strategy and execution of product launches, campaigns, and growth opportunities. It is a generalist role with a strong focus on product and growth that requires experience in product marketing or a related field. The preference is for a NYC-based candidate, but the role is open to remote workers within the US.

Fact

👩‍💼 The Marketing Lead will own the end-to-end messaging, strategy, and execution of product marketing across all channels.

📈 They will evaluate the performance of all channels and optimize and convert as needed.

💻 The Marketing Lead will have a strong background in SEO analytic tools and Klaviyo.

💰 Compensation ranges from $90K-$120K and includes stock options and health benefits.

---

Source: Reddit’s CEO edited comments that criticized him

Summary
The CEO of Reddit, Steve Huffman, has admitted editing user comments in which he was criticised, surreptitiously changing references to his own username to that of a pro-Donald Trump subreddit. Huffman confirmed the edits after they were pointed out to him by other users. He said that he had engaged in the behaviour after facing comments targeting him. Huffman has now apologised for his behaviour, saying that he would not repeat it. The week also saw Reddit ban a separate subreddit based around the “Pizzagate” conspiracy theory, amid concerns for the safety of individuals identified on the thread. 

Fact

👤 Huffman’s Reddit username is spez.

🤐 Huffman replaced references to his own username with moderators of r/the_donald.

🚫 The Pizzagate subreddit was banned following discussions led by Huffman.

---

Source: GM to use Tesla charging network, joining Ford in leveraging the EV leader’s tech

Summary
General Motors has secured a deal with Tesla to access the electric vehicle leader’s charging network and Tesla’s North American Charging Standard, and will install Tesla’s charging port in its EVs from 2025 onwards. The partnership allows GM to save up to $400m of a previously announced $750m EV charging investment while increasing pressure on other automakers and the US government to move towards Tesla’s technology.

Fact

🔌 GM vehicles will gain access to Tesla’s fast chargers via an adapter from next year.

🚗 GM plans to install Tesla’s NACS charging port instead of CCS from 2025.

💰 The deal saves GM up to $400m of a $750m investment to build out EV charging infrastructure.

🏭 GM’s agreement with Tesla follows its rival Ford’s deal with Tesla in August 2021.

📈 The partnership is a significant win for Tesla and puts pressure on other automakers to adopt Tesla’s technology.

---