NLP with GPT

NLP with GPT

gpt-2

gpt-3

GPT Models

• EleutherAI Huge open source Language Models (i.e like GPT-3)

  • EleutherAI/gpt-neo: An implementation of model parallel GPT2& GPT3-like models, with the ability to scale up to full GPT3 sizes (and possibly more!), using the mesh-tensorflow library.

• Huggingface : On a mission to solve NLP, provide many NLP models.

  • transformer : text generation using transformer GPT2

GPT Notes

• Algpt2 Part 2 - Bilal Khan
• Twitter for Academic Research

GPT

• OpenAI’s API Now Available with No Waitlist

GPT Alternatives

• EleutherAI - text generation testing UI
• Studio - AI21
• GPT-3 open-source alternatives: GPT-Neo and GPT-J
• textcortex · PyPI

NLP

• Real-time Market Map - 180+ GPT-3 Examples, Demos, Apps, Showcase, and NLP Use-cases - GPT-3 Demo

• kingoflolz/mesh-transformer-jax: Model parallel transformers in JAX and Haiku Free GPT-J-6B

  • GPT-J “the open source cousin of GPT-3 everyone can use” - Hacker News
  • Text Synth demo
  • EleutherAI - text generation testing UI demo