Data continues to grow and is poised to double in 2024. To help make the process of identifying useful products and services easier, each year, DBTA presents a list of Trend-Setting Products. These products, platforms, and services range from long-established offerings that are evolving to meet the needs of their loyal constituents to breakthrough technologies that may only be in the early stages of adoption.
Posted December 06, 2023
Data quality is becoming a hot button issue as more and more businesses aggressively move into artificial intelligence (AI)—both generative and operational—which requires massive amounts of accurate and timely data. The rise of large language models (LLMs)—both publicly available as well as contained within enterprises—to support business decision making and customer communications means data is being pressed into service in new and highly demanding ways as training data and real-time streaming feeds.
Posted November 30, 2023
U.S. President Joe Biden signed an ambitious executive order on artificial intelligence that aims to balance the needs of cutting-edge technology companies with national security and consumer rights, creating an early set of guardrails that could be fortified by legislation and global agreements. The order is an initial step that is meant to ensure that AI is trustworthy and helpful, rather than deceptive and destructive. The order—which will likely need to be augmented by congressional action—seeks to steer how AI is developed so that companies can profit without putting public safety in jeopardy.
Posted October 31, 2023
According to Gartner, global spending on the public cloud is expected to increase by approximately 20.7% to reach $591.8 billion (about $1,800 per person in the U.S.) in 2023. The advantages of migrating to the cloud are widely recognized. By adopting cloud-first models, businesses can move away from traditional, fixed-cost methods of managing IT infrastructure. Cloud migration allows for controllable, agile, and secure operations that can easily scale as needed while optimizing costs.
Posted October 12, 2023
It may be well-understood that cybersecurity needs to be front and center in all technology projects, but organizations are still slow or hesitant to fully commit to it. This is becoming a problem for data-intensive organizations, which need to brace for an onslaught of both external and internal threats. Only about one-half of organizations are beginning to recognize how important cybersecurity is from the start in any transformation effort, an Accenture survey of 3,000 executives shows.
Posted October 12, 2023
For most enterprises these days, hyperscale data workloads and AI have become the norm and are driving data strategies. However, while conventional wisdom dictates that this means greater reliance on cloud services and cutting-edge approaches to manage data pipelines, there's a place for more well-tread approaches as well. Many data managers intend to beef up their data warehouse capabilities and even return to on-prem systems in the near future.
Posted October 12, 2023
Today's applications—including enterprise applications—need to be always on and always available and often must serve a global base of users who expect almost instantaneous response times regardless of where they are located. Meeting these challenges doesn't just mean happier users: There are direct bottom-line benefits for every business able to tackle the underlying issues of low latency and ultra-high availability. Because of the fundamental role the database plays in every application tech stack, the most logical place to tackle these issues is at the database layer. One of the best and most cost-effective ways to do this is by deploying applications on top of a distributed relational database.
Posted October 12, 2023
Cisco announced it's acquiring Splunk, the cybersecurity and observability leader, building on Splunk's heritage of helping organizations enhance their digital resilience and will accelerate Cisco's strategy to securely connect everything to make anything possible.
Posted September 22, 2023
For more and more organizations, real time is not only the right time—it's the only time that matters. No longer can decision makers afford to only understand the material events affecting their businesses a month, a day, or even just a few hours after the fact. They need a sense of what is happening in the moment to be able to predict and adjust for events that are arising. The value of real-time data "is that it provides needed information to accelerate business insights so teams can make better informed decisions and avoid the issues around using older data," said Tarun Chopra, vice president of product management for data and AI at IBM.
Posted August 10, 2023
Existing data infrastructures are crumbling under the weight of data, leading to unsustainable energy consumption, increased management complexity, and declining security. That's the word from a recent survey of 1,288 executives, released by Hitachi Vantara. The survey also finds 76% feel their current data infrastructures "will be unable to scale to meet upcoming demands"—such as AI. Another 61% report they are simply "overwhelmed" by the amount of data they manage. By 2025, the report's authors predict, large organizations will be storing more than 65 petabytes (PB) of data.
Posted August 10, 2023
With more data than ever being created, making the right choices among the countless options for data management and analytics is a top priority for many organizations. To help organizations progress along their data-driven journeys, each year, DBTA presents the Readers' Choice Awards, which provide the opportunity to recognize companies whose products have been selected by the experts—our readers.
Posted August 09, 2023
Developers have a strong affinity for deploying their applications on open-source database engines, such as MySQL, MariaDB, and PostgreSQL. Amazon Relational Database Service (Amazon RDS) offers these engines as a managed service and manages complex and time-consuming administrative tasks, such as database engine software installation and upgrades, storage management, replication for high availability and read throughput, and backups for disaster recovery.
Posted July 28, 2023
According to PWC's "Future of Experience" survey, 73% of respondents view customer experience as an important factor in their purchasing decisions. Nevertheless, understanding the customer journey can be a difficult and lengthy process for many product developers. Outdated software, the lack of a customer-focused culture, and data silos all contribute to a negative experience.
Posted July 13, 2023
Now that we're emerging from the pandemic and the dust is starting to settle, organizations are taking a good, hard look at their digital transformation and modernization priorities moving forward. To shed light on the adoption and maturity of trending data architectures and where the industry is headed, Unisphere Research, a division of Information Today, partnered with Radiant Advisors to field the latest survey, "Market Study: 2023 Modern Data Architecture Trends," sponsored by Cambridge Semantics, Informatica, Kinetica, Teradata, and Vertica.
Posted July 13, 2023
All eyes are on AI this year, with the space heating up as generative AI arrived on the scene with the popularity of ChatGPT technologies, along with new tools for automation and ease of use allowing companies to gain deeper insights into their analytics and better serve their customers.
Posted July 12, 2023
The healthcare industry, much like other industries, is witnessing a surge in data growth due to Electronic Health Records (EHR), medical imaging, population sequencing, and claims processing. According to the World Economic Forum, hospitals generate 50 petabytes of info every year, yet 97% goes underutilized for various reasons, such as data sitting in silos, being stored as unstructured and semi-structured data, and more.
Posted July 06, 2023
There's no question that this year, we're seeing dramatic upheavals in the data and analytics space. AI, of course, is the subject du jour, but any discussion of AI and its potential must, by necessity, involve the data teams that provide the information that makes AI successful. Here are what industry leaders and experts see as the most important technologies shaping the growth of data-driven enterprises.
Posted June 08, 2023
The issue of data silos has long hamstrung the efforts of data managers and their business counterparts to get an accurate, real-time picture of their enterprises. Now, a recent study suggests that open source technologies and data cloud platforms are helping to clear up these silos. Is this finally the long-sought, silo-busting holy grail?
Posted June 08, 2023
The need to balance data safety with new data initiatives, deliver business value, and change company culture around data tops this year's list of data and analytics management challenges. To help bring new resources and innovation to light, each year, Database Trends and Applications magazine presents the DBTA 100, a list of forward-thinking companies seeking to expand what's possible with data for their customers. Spanning the wide range of established legacy technologies from MultiValue to cutting-edge breakthroughs such as Web3, the DBTA 100 is a list of hardware, software, and service providers working to enable their customers' data-driven future.
Posted June 07, 2023
The global hype surrounding ChatGPT, large language models (LLMs), and generative AI has launched a plethora of conversations about its efficacy in the business sphere; yet understanding how to best leverage these tools remains rather elusive. At Data Summit 2023, David Seuss led the session, "Investigating Neural Networks and AI," focusing on what ChatGPT, LLMs, and generative AI are, as well as how they can provide a competitive edge for a wide variety of organizations seeking to drive positive business outcomes.
Posted May 11, 2023
MLOps can streamline machine learning development, thus increasing operational effectiveness. With this in mind, Joey Jablonski, VP, analytics, Pythian, looked at the journey to defining and implementing an MLOps solution for the organization during his Data Summit 2023 presentation, "Building MLOps Organizations for Scale."
Posted May 11, 2023
Data science methods provide a means to establish analytic tradecraft, capable of managing a large amount of data, allowing for full characterization of actor behaviors, and providing valuable insights. Efrain Rodriquez, data manager, U.S. Department of Defense (DoD), presented a case study on how the intelligence community (IC) is addressing these challenges by establishing innovative AI/ML governance and data management methodologies, during his Data Summit 2023 session, "Using Data Management Methodologies to Foster Development of Transformational AI/ML Tradecraft."
Posted May 11, 2023
Databases contain valuable business assets; ensuring this information is secure is paramount. SQL Compliance Manager by Idera can protect those assets and help address your industry's strict regulatory compliance requirements with confidence, providing HIPAA-compliance, GDPR-compliance, and more.
Posted April 14, 2023
Are we finally seeing the democratization of artificial intelligence (AI)? New research out of OpenAI and the University of Pennsylvania suggests that generative AI, thanks to open and widely available tools such as ChatGPT (Generative Pre-trained Transformer) models and GPT-4, will be part of the jobs of at least 80% of occupational groups.
Posted April 13, 2023
The pandemic significantly accelerated the pace of technological advancement and digital transformation, generating a need for new digital programs and solutions. The drive to meet this demand has increased pressure on IT departments, which, in turn, has heightened collaboration between IT and line-of-business (LOB) executives. Business technologists, or staff members who are not in the IT department but leverage technology to solve their business problem to improve the productivity of their department, are increasingly choosing the applications, technology frameworks, and platforms that help them solve their business problems without heavy reliance on IT.
Posted April 13, 2023
Just a few years ago, no one would have imagined running their SQL Server databases on anything other than Windows Server. Now, with companies requiring data-driven capabilities for a range of needs, the idea of running SQL Server on a non-Windows platform has become almost commonplace—whether on open-source operating systems or in the cloud.
Posted April 13, 2023
In mid-2020, I got a chance to work with several government tourism agencies. Their mandate was to promote local attractions and offer support to partners such as hotels, resorts, and other organizations. As you can imagine, things weren't going well for these agencies. I remember looking at their data reports and seeing unprecedented drops in volume. With every country imposing restrictions and lockdowns, no one was traveling. One agency stood out; it was completely frozen by the situation. It couldn't decide on anything. Even publishing the latest COVID numbers was difficult.
Posted April 13, 2023
Organizations rely heavily on SAP systems and applications to run crucial business processes; securing these systems against cyber-attacks is vital. While several cybersecurity frameworks exist to manage cyber risks, they use generic wording that is hard to apply to application security and lack specific guidance to cover SAP environments. As a result, organizations must select the right frameworks to enhance their security posture and streamline complex security operations to safeguard critical assets from attacks.
Posted March 09, 2023
Observability by definition is a measure of how well internal states of a system can be inferred from knowledge of its external outputs. In other words, a system's behavior is determined from its outputs—information obtained by certain measures. Though observability as a term has been used for many years, the modern understanding originates in software observability, which is the ability to collect data about program execution, internal states of modules, and communication between components.
Posted February 09, 2023
While the emerging constellation of next-generation data architectures—fabric, mesh, and cloud—is extremely appealing, it's still full of unknowns. These approaches present opportunities for greater data democratization, but also increased complexity. Understanding the distinctions between data fabric and mesh are also important before moving to this architecture.
Posted February 09, 2023
Data analytics—and the people who make it happen—has emerged as the centerpiece of enterprises as they advance through the turbulent months ahead. Many of these efforts are gelling around the formation of dedicated C-level leaders, such as chief data officers and chief data analytics officers (CDOs and CDAOs, respectively).
Posted February 09, 2023
In 2009, AWS pioneered fully-managed cloud database services for open-source database management systems (DBMS) with the launch of Amazon Relational Database Service, or Amazon RDS. The ambition was to accelerate the adoption of open-source databases, like MySQL and PostgreSQL, so developers can focus on building new applications while removing the worries associated with managing database instances. In parallel, AWS has fostered a close relationship with multiple open-source communities to accelerate the adoption of open-source databases while providing enhancements that developers want with over 435 accepted contributions from the AWS Databases team back to the open-source communities, year-to-date.
Posted February 03, 2023
Uncertain economic conditions, skills shortages, rising automation, increasing regulation, and digital disruption—all add up to a stew of both challenges and opportunities for data managers in the year ahead. Emerging technologies—and new attitudes—are reshaping the look and scope of the information management landscape, with implications for overall business strategies and individual careers alike.
Posted January 12, 2023
Moving to the cloud may seem, on its surface, a good way to better manage the quality and viability of data resources for enterprises. However, as data accelerates its move to the cloud, the complexity involved in assuring quality and viability has only increased.
Posted January 12, 2023
For the eighth consecutive year, Amazon Web Services is named a leader in Gartner's annual "Magic Quadrant" rankings for the cloud database space. The new rankings, which evaluate the world's top 20 data and analytics companies, have elevated AWS into first place as the leader in vision, as well as ability to execute. At its recent re:Invent conference, the company unveiled a new generation of enhancements which introduce greater performance and integration to its cloud-based databases services.
Posted January 10, 2023
Today's data environments are highly diverse—residing on many platforms and requiring a variety of approaches to ensure data resiliency and availability. Delivering technology alone will not be enough in 2023. To help make the process of identifying useful products and services easier, each year, DBTA presents a list of Trend-Setting Products. These products, platforms, and services range from long-established offerings that are evolving to meet the needs of their loyal constituents, to breakthrough technologies that may only be in the early stages of adoption.
Posted December 08, 2022
In the ever-shifting markets professionals work in today, companies must have the ability to remain agile and flexible throughout their business operations. To combat the uncertainties of the marketplace and customer demands for fast service, businesses have turned to open-source technology over the past decade. Open-source technologies provide IT and development teams with the agility to implement innovative tools and practices—such as DevOps and Continuous Integration and Continuous Delivery (CI/CD).
Posted December 08, 2022
When designing a data center, a recognized set of principles is typically followed. Scalability, resiliency, reliability, and sustainability are all essential, but the most important common feature for data center products may be flexibility. The equipment cabinet should likewise be flexible, but this has not always been the case. There has been a rethinking of the way IT infrastructure, power, and cooling converge—and the data center cabinet is starting to adapt.
Posted November 10, 2022
The world is increasingly online, and online is increasingly real-time. This presents interesting performance challenges for databases, and Amazon MemoryDB for Redis is purpose-built to address them. According to a recent statistic, more than 5.47 billion people have access to the Internet which is approximately 69% of the world's population. This number has increased by a staggering 1.1 billion since 2019 or approximately 12% of the world population is now accessing internet for the first time.
Posted October 17, 2022
Software audits—in which vendors probe enterprise customer implementations for overuse of licenses or unauthorized installations—are becoming a big business—and an emerging source of revenues. Whether on-premises or accessing services through the cloud, many companies report having been the subject of software audits, often resulting in tens of thousands of dollars of assessments.
Posted October 06, 2022
Is it getting easier or more difficult to lock down data in today's digital enterprises? Industry leaders have mixed opinions on the state of that challenge. Cloud vendors promise industrial-grade security for backend applications and data, while at the same time the move to cloud increases complexity.
Posted October 06, 2022
As one of the fundamental building blocks of the metaverse, IoT digital twins have moved beyond the realms of simulation to facilitate an understanding of real-world problems. Take the European Union's "Destination Earth" initiative. This is drawing on a host of environmental, socioeconomic, and satellite data to develop digital "twins" of the planet in an effort to combat climate change, but the benefits do not stop there, particularly in the B2B world. For risk-averse companies in asset-intensive industries, digital twin technology is set to bring unparalleled value to mission-critical maintenance tasks and enable the delivery of more immersive product experiences to the end customer.
Posted October 06, 2022
Kubernetes (K8s) gives us an elegant approach to scaling stateless workloads. By itself, scaling stateless workloads will run into bottlenecks if the underlying database doesn't have a corresponding approach to scaling its workload. As an Amazon Web Services (AWS) managed service, Amazon Aurora Serverless v2 mirrors K8s by providing a similarly fluid ability to scale the database workload. This article describes how you can bridge these two worlds to get the best of each world by managing Amazon Aurora as an external AWS managed resource directly from K8s.
Posted October 04, 2022
Many customers choose to run their Microsoft SQL Server workloads on Amazon RDS for SQL Server to take advantage of its fully-managed services, high performance, and straight forward homogeneous migration to the cloud. Speed and performance are often prioritized over cost when customers first move to the cloud, which results in oversized instances and underutilized spend on unused resources. However, rightsizing your databases in the cloud is needed to achieve long-term cost efficiency.
Posted September 22, 2022
Data observability is a relatively new discipline in the fields of data engineering and data management. While many are familiar with the longstanding concepts of observability and monitoring in enterprise IT networks and infrastructure, data observability has only really come into the spotlight in the last two years. However, it has managed to turn a lot of heads in that short time.
Posted September 08, 2022
NoSQL databases, also referred to as non-relational, continue to grow in popularity both on-premises and in the cloud. Of the 395 different database management systems tracked by site DB-engines, more than half are non-relational. These include key-value, document, graph, time series, and many more database models that fall into the NoSQL category. As more organizations modernize their applications or develop new applications from scratch, they adopt a microservices-based architecture that allows them to take advantage of the benefits of NoSQL databases
Posted September 06, 2022
Microsoft SQL Server is a relational database service that supports transactional processing and analytics. With a 30-plus year history, SQL Server has been a mainstay at many organizations. Now, however, open-source technologies like PostgreSQL, have become increasingly popular for customers. More and more customers are migrating to them from overpriced, restrictive commercial databases that lock them in. With an increasing array of choices, the same organizations are looking for lower cost options, including low-cost, cloud-native, fully managed database services like Amazon Aurora PostgreSQL-Compatible Edition, as this lowers total cost of ownership while providing the desired performance.
Posted September 06, 2022
Kubernetes has fundamentally changed the way organizations manage and deploy software. At its core, Kubernetes provides a unified API for infrastructure that abstracts differences between cloud providers and their underlying infrastructure so that Kubernetes users can focus on defining their application workloads. By popularizing declarative management of resources, Kubernetes has transformed the IT landscape, particularly through "GitOps" workflows. Kubernetes is also extensible, enabling users to build their own APIs through custom resource definitions and controllers.
Posted August 25, 2022
Today's enterprises need to be more agile to improve their customer's experience, respond to changes quickly, and have the freedom to innovate. As part of their digital transformation journey in the cloud, these businesses need the ability to connect more devices to their applications, faster than ever—from smartphones to connected cars, from manufacturing plants to smart devices in our homes. Therefore, these applications need to scale quickly to potentially millions of users, have global availability, manage large volumes of data, and provide ultra-fast response times for customers.
Posted August 25, 2022
Thanks to significant innovation and recent disruption in the data management space, organizations are achieving unprecedented value from both internal and external data. Much emphasis has been placed on the importance of achieving digital transformation, yet thanks to these rich data assets, organizations are finding new ways to serve customers across both digital and physical boundaries.
Posted August 11, 2022