Listen Live
Trending:
Industry Exchange Data '24 Cloudera's Tej Tenmattam
Industry Exchange Data '24 Cloudera's Tej Tenmattam
Big Data

Industry Exchange Data 2024: Cloudera Government Solutions’ Tej Tenmattam on unified data, AI management

A unified approach to data management enables safe, reliable training and deployment of your organization’s artificial intelligence applications, he shares.

Commentary

Commoditization of data will drive federal mission success

Commentary

Data in motion: The hybrid infrastructure currency of the digital age

Federal Insights

Expert Edition: Data Security

Cloud Computing

Cloud Exchange: Why a successful hybrid cloud strategy requires a data strategy

Federal Insights

Getting the most out of your cybersecurity data requires normalizing and a tiered storage approach

Defense

DoD Cloud Exchange: Rob Carey, Cloudera

FEF_IT Modernization 2021
Federal Executive Forum

IT Modernization in Government 2021 "Progress & Best Practices"

Head shot of Henry Sowell
Federal Tech Talk

Not your father's Cloudera

Jason Miller and Henry Sowell
Innovation in Government

How agencies can harness their data to drive better decisions

Head shot of Mike Olson
Federal Tech Talk

An outsider's view of innovation

Head shot of Dave Schuman
Federal Tech Talk

The power of data

Futuristic world map traffic design in vector
Technology

Federal managers working on 'culture change' for cross-component data sharing

Federal News Radio pinwheel icon
Commentary

3 steps to prepare for next hack or breach

<iframe title="YouTube video player" src="https://www.youtube.com/embed/1a8VSA9sJMQ?si=vxXB4bMV3eSKG8Ze" width="560" height="315" frameborder="0" allowfullscreen="allowfullscreen"></iframe> Training artificial intelligence models properly requires above all the right data. So it makes sense that an agency needs to establish an enterprise data governance and management strategy to improve confidence in deploying AI. The data strategy should cover data regardless of format or where it is stored in hybrid cloud environments, said Tej Tenmattam, principal solutions engineer at <a href="https://www.cloudera.com/solutions/public-sector.html">Cloudera Government Solutions</a>. “Data relevant to AI models are scattered across on-premise databases, data lakes in the cloud and data in several departmental applications,” he said during <a href="https://federalnewsnetwork.com/cme-event/big-data/federal-news-networks-industry-exchange-data-2024/"><strong><em>Federal News Network’s Industry Exchange Data 2024</em></strong></a>. What’s more, Tenmattam added, “this fragmentation makes it difficult to gather and prepare the data needed for training and then deploying AI models.” Data an agency might need for AI likely exists in a garden variety of formats, and that datasets likely come with different degrees of quality and reliability too. <h2>Taking a unified data tack to drive better outcomes</h2> Overlaying the specific data requirements are security needs, Tenmattam said. Agencies must deploy safeguards such as role-based access controls, data encryption in transit and at rest, and compliance controls for personally identifiable information. Moreover, Tenmattam advised, “you need data quality tools so you are able to do data profiling, data cleaning, lineage tracking and so on.” It’s a tall order because poor or poorly managed data will produce predictably bad outcomes in artificial intelligence projects. As Tenmattam put it, “Data quality issues like incomplete, missing or old data … reduces the accuracy as well as reliability of the AI models that you’re building. Poor data quality and accessibility lead to biased and inaccurate or underperforming AI models.” An agency needs a unified data strategy, a data fabric approach that encompasses integration, quality, security and governance, he said. The strategy should “support data discovery, how you provide access and how you share the data.” Cloudera’s data platform encompasses many of the tools necessary to manage data in this manner, Tenmattam said, such as NiFi Expression Language, Kafka connectors, Flink stream processing engine and Hadoop-Spark combinations for processing management. “You need a data platform that is built on next-generation, cloud-native technologies,” such as Kubernetes, he said. The platform must “scale on AWS, Azure, Google Coud or in your own on-premise environment. A multicloud strategy and the ability to easily scale are very important.” <h2>Extracting value form an AI strategy now and later</h2> A comprehensive approach to managing large datasets from multiple sources supports not only AI but also applications that combine AI with near real-time data analytics. He named aircraft maintenance, fraud detection, supply chain optimization, traffic monitoring and crime detection as examples. What these use cases have in common is the need to combine large amounts of data quickly from multiple sources. The most useful applications can flag anomalies as they occur, adding to an organization’s knowledge base for later analysis, Tenmattam said. A solid data strategy can help an agency prepare for where the AI industry is heading too, he advised. He said users will increase what he called a focus on explainability of artificial intelligence, “understanding how AI models arrive at decision. That is crucial for building trust.” The rise in use of generative AI will accelerate, Tenmattam said. Output in the form of new datasets from large language models won’t be limited to text but will also include images and software code. “Responsible AI development is extremely important to future trends. Ethical considerations are becoming paramount in AI development and deployment.” <em>Discover more tips and advices shared during </em><a href="https://federalnewsnetwork.com/cme-event/big-data/federal-news-networks-industry-exchange-data-2024/"><em>Industry Exchange Data 2024</em></a><em> now.</em>
Federal Insights

Cybersecurity vs. Data Security: Government’s Two-Pronged Challenge

olsen2_cloudera_230x150.jpg
Federal Tech Talk

The cloud, Cloudera, and the federal government

booz.jpg
Defense

Big Data: Advancing the Art of Analytics