"Startup 'Writer' leverages NVIDIA NeMo to create successful case of generative AI"

2023-08-09

Waseem Alshikh, an expert in software development, is utilizing generative AI to create content for hundreds of companies. Born and raised in Syria, Alshikh faced the challenge of studying textbooks written in English during his time at university. To overcome this language barrier, he developed a program that could summarize the content of these books, allowing him to learn from the summaries. In 2014, while working in Dubai, Alshikh met entrepreneur May Habib, and together they founded a startup aimed at helping marketing departments quickly generate web pages, blogs, and advertisements using machine learning. The company, initially named Writer, gained traction after the introduction of transformer models, which served as the foundation for their work. The startup's CTO explained, "Initially, the technology was not mature, until the transformer model was introduced - that became the cornerstone of everything." Writer, in collaboration with NVIDIA, built their first model, a neural network with approximately 128 million parameters, which is a common metric used to measure the capability of AI models. Writer's success led to partnerships with renowned companies such as Deloitte, L'Oreal, Intuit, and Uber. The company's client list continues to grow, with many organizations utilizing their models customized for various vertical markets, including finance, healthcare, and retail. To accelerate their work, Writer leveraged NVIDIA NeMo, an application framework that assists companies in planning their training datasets, building and customizing large language models (LLMs), and scaling them in production environments. NeMo has been widely adopted by organizations worldwide for customizing LLMs in their local languages and industries. Alshikh expressed his amazement at the efficiency NeMo brought to their work, stating, "Before NeMo, it took us four and a half months to build a new one billion parameter model. Now we can do it in 16 days." Writer's success story is just the beginning, as numerous other companies have also adopted NeMo. The software will soon be available to the public as part of NVIDIA AI Enterprise, a full-stack software optimized for accelerating generative AI workloads, with enterprise-level support, security, and stable application programming interfaces (APIs). Some clients choose to run Writer's models on their own systems or cloud services, while others prefer Writer to host the models or utilize their API. Alshikh proudly shared that their cloud infrastructure, managed by just two people, handles trillions of API calls per month, generating 90,000 words per second. He emphasized that Writer offers high-quality models that compete with products from companies with larger teams and higher budgets. Writer utilizes Triton Inference Server, packaged with NeMo, to run models in production environments. Alshikh reported that Triton is widely used by companies running LLMs, as it achieves lower latency and higher throughput compared to other programs. With the success of their text-based products, Alshikh is now exploring opportunities in other areas of generative AI, such as images, audio, video, and 3D. He believes that multimodality is the future of AI. In conclusion, Waseem Alshikh's expertise in software development, combined with the power of generative AI and the support of NVIDIA NeMo, has enabled Writer to create high-quality content for numerous companies across various industries. The company's success has positioned them as a leader in the field, with plans to expand into other modalities in the future.

RECENT AI NEWS

RECENT AI TOOLS