Combining Generative AI with Automation and APIs: realizing AI at scale
Combining Generative AI with Automation and APIs: realizing AI at scale Follow on: Generative AI models and similar architectures are known for their impressive and versatile features. These models have revolutionized natural language understanding and generation. The Generative capabilities like text generation, translations, summarization, and keyword/metadata extraction are applicable in various industries in the areas of marketing automation, customer relation management applications, ERP, Promotion, and Loyalty applications and are seamlessly integrated into the HTC MAiGE platform through scalable and highly available microservice containers with API driven approach. Reusable components like data synthesizers, semantic search, and metadata extractions are integrated with automation processes that are event-driven/batch schedulers through configuration or metadata-driven approaches, which effectively can be used for any of the Model training processes like building recommendation/prediction/classifier engines, etc. How HTC MAiGE platform Generative AI APIs solve Industry use cases. HTC MAiGE platform Generative AI APIs are driven with a template-based approach that standardizes and simplifies usability and development efforts and maintains consistency across system. Based on different scenarios, the HTC MAiGE platform Generative AI APIs are integrated with Prompt Engineering frameworks that create prompt requests and send them to the Generative AI models, integrated with semantic search flows, fine-tuning models, and integration with other system and enterprise APIs based on the requests. A few of them are listed below and used in various industry use cases. APIs for the customer journey in a transactional-based system Scenario for order management system Generative AI can power chatbots or virtual travel assistants that engage with users in natural language. These AI-powered assistants driven with API based integrations can handle a wide range of tasks, including ordering products, providing product recommendations, answering questions, and assisting with pricing details. API for content personalization: Scenario for Marketing and Automation The content that has to be personalized targeting users based on dynamic profiling/segmentation can leverage HTC MAiGE Platform Generative AI API, which personalizes the content based on user profiles and targets to generate personalized email campaigns. The content that has to be personalized targeting for channel-friendly can leverage HTC MAiGE platform Generative AI APIs for channel-friendly content creation that personalizes the content based on the targeted marketing channel. Scenario for Recommendation Engines Various recommendation engines can integrate with the HTC MAiGE platform Generative API for providing personalized recommendation content to the targeted users and channels for product promotions. API for metadata extraction/summarization: Scenario for Insurance Industries Extract relevant information from claim forms, such as claimant details, incident dates, descriptions of events, and supporting documents. Summarize claim documents to give claims adjusters a quick overview of the claim, helping them make faster and more informed decisions. Generate summaries of applicant data, making it easier for underwriters to assess risk and determine policy eligibility. Scenario for Retail Industries Create inventory summaries to provide an overview of stock levels, restocking needs, and product categories. Summarize competitor data to identify pricing trends, product assortments, and market positioning. Summarize customer sentiments and reviews to gain insights into product satisfaction and identify areas for improvement. API for audio-text-iMAGE conversions Scenarios for healthcare industries: Digital scribe agent that captures a doctor’s conversation with the patient, transcribes the audio to text, translates to the required language, creates the summary from the transcribed text Scenarios for Insurance industries: Claims agent that can receive audio files from insures, transcribes to text, extracts the metadata, and determine the severity of the loss Property iMAGE interpretations converted to the text used in dynamic underwriting use cases. Generative API’s scalability and automation With APIs built in through the HTC MAiGE platform for all the Generative AI capabilities, the platform provides seamless integrations to external systems/partners. These APIs have the capability to integrate with the workflow management that caters to end-to-end business capabilities. HTC MAiGE platform user interface built with micro-frontends are integrated with scalable approach through backend APIs. Given the core components for the HTC MAiGE platform for Data ingestion, Auto EDA, data transformation, and scalable AI model components integrations, the Generative AI APIs can be seamlessly integrated with integration services that have the capability to build rule engines, workflows, etc. For example, a retail industry looking to build a robust Recommendation system can leverage the HTC MAiGE platform, integrating with Data ingestion, EDA, and transformation process that connects to different data sources related to products, customers, inventory data, etc, and use Generative AI APIs of HTC MAiGE platform that can synthesize the required data for model training, build the model and deploy the model for recommendations. As required, the HTC MAiGE platform Generative API can integrate with other deep learning/ML-based algorithms for data synthetization, classification, and enrichment, making more model accuracy. The APIs are integrated with the HTC MAiGE MLOps platform for continuous builds and deployments, monitor and check for any model drifts, and trigger the hyperparameter tunings or model fine-tunings if there are any drifts. The APIs are built with a Microservice framework with core features like service discovery, resiliency through circuit breaker, and load balancing, ensuring the services are highly auto-scalable and highly available, ensuring zero downtime. Generative API Security and Data security The Generative APIs are integrated with enterprise security leveraging OAuth2/OpenID connect. The APIs for synthetic data generator adheres to data privacy, compliances, and reduced model bias. Automation HTC MAiGE platform automation is spread over different areas, from Data Engineering(ETL) to Industry Use cases. ETL process HTC MAiGE Platform ETL process integrated with Language Model (LLM) assistants powered by NLP, allowing business users to query domain-specific entities and fetch data effortlessly. ETL framework enables seamless connections to multiple data sources, facilitating easy data ingestion, transformations, and visualizations. Auto EDA framework The HTC MAiGE Platform, Auto EDA framework, leverages NLP to provide insights into data completeness, quality, and summary. Users can visualize correlations, helping them identify and resolve data issues swiftly. The framework is integrated with HTC MAiGE platform APIs seamlessly from any channel. Web Scraping The HTC MAiGE platform has built automation scripts to scrape large amounts of text or data from websites, social
AI beyond the hype: why this is truly a transformative moment for technology
AI beyond the hype: why this is truly a transformative moment for technology Follow on: AI has been envisioned as a business multiplier for decades, but its adoption has only recently gained pace. Why? Low technology maturity levels, the lack of enabling infrastructure, and AI-led capabilities limited AI’s growth. While its potential was undeniable, its implementation was a challenge. The technology landscape, however, has changed dramatically over the past few years. Enabled with cloud scale and GPUs, complex data crunching to enable AI at scale is possible today. With rapid evolutions in hardware, newer capability areas in AI, such as generative (specifically almost human-like Large Language Capabilities), have emerged. Now, AI can accelerate the time to value. AI’s transformative potential, hence, is not only being acknowledged but also realized at scale. However, we need to keep in mind the benefits AI implementation will offer to the customers instead of looking at AI as just another piece of technology. Every AI project should be driven by user/customer centricity. The dawn of reality: validating the AI metamorphosis The year 2023 witnesses a pivotal juncture in the AI narrative, a watershed moment affirmed by the findings of the McKinsey Global Survey. At the heart of this transformation is the meteoric rise of Generative AI (Gen AI) tools. What was once an experimental pursuit is now propelling businesses to harness gen AI in their daily operations. According to the report, nearly half (48%) of medium to large organizations in the US have advanced to higher AI maturity levels of AI maturity, marking an 8% surge compared to last year’s survey findings. Among mid-to-large US organizations, 52% are currently in the experimental phase of AI implementation. Those at the mature stage are more inclined to leverage AI for future strategic gains, while the experimenting group primarily focuses on mitigating risks. However, irrespective of where these businesses stand on their AI maturity journey, nearly 40 percent of enterprises affirm their intent to amplify AI investment. At HTCNXT, we realized AI’s potential quite early, and our mission of transforming enterprises into AI-first organizations began at home. At HTCNXT, our core mission is AI, and we have been developing ready-to-deploy industry-specific solutions, working with clients to implement AI for their problem areas, and developing our own AI platform called HTC MAiGE. We have also been eating our own dog food and using our own solutions in our business services group, customer service products, and quality engineering teams. AI solutions today sit at the heart of many of our processes. And we have seen realized benefits in productivity and efficiency as we do this. For our customers, our solutions have helped a global automotive manufacturer eliminate recurring problems in procurement and streamline their workflow to save significant costs. Our solution enhanced the interactive training modules with a VR-based 360° solution for a multinational mass media and entertainment conglomerate. We also helped a large public research university in California build AI/ML-driven solutions for managing technical data. And this is just the tip of the iceberg. Riding the AI wave Building on our AI expertise, we developed our platform HTC MAiGE. Its plug-and-play solution is designed for enterprises to harness the full potential of AI, innovate with precision, and elevate their operations to new heights. Being component-driven, it can be seamlessly integrated into existing IT infrastructure to drive value sooner. Furthermore, our tested approach helps enterprises adopt AI technology through the stages of Learn, Scale, and Transform. Leveraging the immense capabilities of HTC MAiGE, we are helping enterprises test the viability of AI for their business, scale its implementation, and take the strategic call to enable enterprise-wide adoption. Our holistic approach has been instrumental in improving AI maturity levels for enterprises at a rapid pace. Setting up the ethical guardrail Large language models (LLMs) hold great potential but also bring challenges for organizations. These models can produce content that doesn’t match an organization’s needs or ethical guidelines. Without safety measures, there’s a risk of creating harmful or biased content. To use LLMs responsibly, organizations must establish guardrails to define their boundaries. There are four ways to create effective guardrails for LLMs: Develop specific LLMs from trusted sources, but this is resource-intensive and doesn’t eliminate all risks. Customize LLMs with optimization techniques aligned with industry policies. Manually verify models for vulnerabilities through red teaming, which is slow and costly. Use agent-based models to automate verification and governance, ensuring safe interactions. Among these, agent-based modeling stands out as the most suitable option for securing LLMs for enterprise use. It enforces technology and security rules, ensuring safe interactions with generative AI. HTCNXT’s HTC MAiGE weaves the AI magic HTC MAiGE is a testament to the relentless pursuit of technological excellence. This platform harmoniously orchestrates various technology stack components, effectively converging data, algorithms, and computing resources. Embodying the essence of AI evolution, HTC MAiGE paves the way for organizations to unleash innovation, gain invaluable insights, and make well-informed, data-driven decisions. HTC MAiGE empowers businesses to innovate across diverse domains, extending its transformative touch to four cornerstone industries: Retail: HTC MAiGE’s capabilities drive personalized customer experiences, dynamic pricing, virtual assistants, and demand forecasting. From visual search to product recommendations, retail revolutionizes through AI. Insurance: Enhancing risk assessment, claims processing, and fraud detection, HTC MAiGE redefines efficiency in insurance operations while delivering personalized customer experiences. We recently helped an insurer reimagine claims intake with an AI-based FNOL (First Notice of Loss) solution, enhancing digital experiences for claimants and staff while reducing costs. Health: With capabilities spanning medical imaging, personalized medicine, telehealth, and clinical decision support, HTC MAiGE transforms healthcare, enhancing patient care and medical research. Travel: By enabling personalized travel recommendations, dynamic pricing, and enhanced customer services through chatbots and virtual assistants, HTC MAiGE takes travel experiences to new horizons. Forging ahead There’s no denying that Gen AI’s advent heralds a new dawn, a chapter steeped in progress. As we traverse this landscape of uncharted potential, HTCNXT extends an invitation. Venture forth, chart your course through
Generative AI’s true opportunity in Retail
Generative AI’s true opportunity in Retail Follow on: The retail industry is rapidly adopting Machine Learning, Computer Vision AI, and smarter AI-led solutions to enhance customer experiences, drive supply chain optimization, smarter in-store operations, and more. Generative AI, however, can help them achieve more. It can significantly improve the team’s productivity, create personalized customer interactions, and accelerate code creation, testing, and debugging for the IT engineering teams. Gartner’s recent emerging tech roundup report reveals that a significant shift in generative AI usage is anticipated in various sectors. By 2025, generative AI is projected to play a pivotal role, generating 30% of marketing content, substantially augmented by human input, a substantial leap from the meager 2% in 2022. Advanced virtual assistants (VAs) are also undergoing a transformation. Over 50% of VAs are predicted to become specialized for specific industries, a considerable rise from the earlier 25% in 2022. Generative AI and foundation models will transform software products in two years, driving up productivity, augmenting customer support, and decision intelligence across diverse domains. Generative AI assistants are already being utilized to transform how customers search for products. For example, with a chat/voice-based interface, customers can request a recipe and receive product recommendations with a list of ingredients used in the recipe. This simplifies searching for ingredients while improving sales and customer satisfaction. The latest advancements in ChatGPT/Azure OpenAI, like plugins and code interpreters, open yet more opportunities for retailers to sharpen their targeting and complement the productivity of retail associates. A key impact area of Generative AI has been the evolution of retail media networks. This new and alternate revenue channel for retailers is already creating a positive impact on the bottom line for leading retailers and will remain the focal point of innovation for online, offline, and in-store targeting. The result? Targeted and personalized ads get better, costs drop, and shopping gets smoother. While retail media networks seize the spotlight, other use cases further underline AI’s importance in retail: Driving autonomous store operations: AI-driven automation reimagines store operations, allowing employees to amplify customer satisfaction. Automated restocking, predictive maintenance, and theft prevention guarantee secure and efficient store functions. Powering fulfillment AI: Swift deliveries materialize through AI-powered adaptable supply chains. AI monitors demand, stock availability, and location, facilitating optimized fulfillment for unparalleled customer delight. Enabling demand forecasting: AI-generated demand forecasts empower retailers to outpace competition. These insights recalibrate prices and fortify supply chain resilience, empowering businesses with a competitive edge. Improving customer engagement – Chatbots and copilot assistants can power natural language conversations in customer support and eCommerce, simplifying shopping for customers. Refining product merchandising – Generative AI can help create persuasive descriptions and utilize unstructured data from customer interactions to generate novel product improvement ideas, thereby improving product development and refinement. Enhancing commerce – Generative AI can elevate the personalization game with specific situations and need-based product recommendations. It can generate SEO-centric product copies for websites and social media posts supplemented with generated imagery. Improving associate’s experience – Generative AI can act as a trainer and copilot for the store associates providing micro training, enabling help with routine tasks, and empowering them with natural language queries for specific information. This can lead to improved associate morale and enhanced overall productivity. Powering IT teams – Generative AI can help IT teams generate code and resolve issues faster, perform tests using LLM-generated test cases, and fix technical debt with code analysis. Empowering data teams – The retail data teams can leverage Generative AI analytics features allowing users to query for insights using natural language. This capability can empower the teams with improved insights and accurate decision-support tools. Driving supply chain resilience – Generative AI can ensure the amalgamation of data from various sources to interpret and visualize the multi-source data inputs into charts and graphs. Real-time visibility can fast-track decision-making, improve supply chain robustness, and enhance operational resilience. Real-world application of GenAI: Industry titans like Nestle and Unilever are at the forefront of this transformation through Generative AI, reshaping ad campaigns and product marketing. Collaborations among these companies are yielding innovation and cost-effectiveness, bridging creativity and efficiency in campaigns that resonate globally. Through the adoption of ChatGPT 4.0 and DALL-E 2, Nestle is harmonizing AI-generated ideas with human creativity, rewriting the norms of marketing excellence. Retailers, however, must recognize that there are shortcomings in Generative AI models. They need to ensure a proper governance model to prevent any spread of misinformation due to hallucinations, inadvertent sharing of confidential information, or privacy breaches. With the technological advancements continuing, retailers can expect more novel use cases for Generative AI. It is crucial for them to start preparing and building the foundations for an AI-first enterprise. Generative AI will undoubtedly play a leading role in revolutionizing retail experiences, and the time to create such experiences starts now. Click here to learn how HTCNXT can help you leverage Gen AI in your retail operations with our ready-to-use AI platform HTC MAiGE. Sources: A Paradigm Shift in Advertising AUTHOR Adnan Saulat Senior Vice President, Consumer Services SUBJECT TAGS #ArtificalIntelligence #GenerativeAI #AIinRetail #RetailInnovation #RetailTechnology #CustomerExperience