Big Data Quarterly Articles



When building a product or application, most systems designers understand that you can't have it all. Creating a high-performing and scalable system can be a daunting challenge since those considerations are often in opposition to one another—typically high performance in a single machine's memory space or scalable across several servers.

Posted February 14, 2022

Teradata has announced the results of one of the largest-scale cloud analytic tests ever undertaken in the industry. "As critical analytic workloads increasingly move to the cloud, we recognize the need to provide our largest enterprise customers with a single system to manage all of their complex analytics," said Hillary Ashton, chief product officer at Teradata.

Posted February 10, 2022

Wallaroo Labs, a company that helps enterprises deploy, run, and observe ML models in production at scale, has closed $25 million in a Series A round led by Microsoft's venture arm, M12.

Posted February 10, 2022

There's been a lot of hype recently around the concept of a data lakehouse, and for good reason. Essentially, it is a new data management paradigm that combines the capabilities of data warehouses and data lakes, changing the way data teams operate together. This new architecture represents a significant fundamental shift in the way we work with data.

Posted February 08, 2022

The noted motivational speaker and author Zig Ziglar was quoted as saying, "When obstacles arise, you change your direction to reach your goal; you do not change your decision to get there." This sentiment rings truer today than ever. In the past 21 months, companies across every industry have had to alter their "go-to-market" strategies to simply survive. For the local diner, this may have initially meant relying on take-out orders, then finding ways to create outdoor seating areas, and later dealing with the weather inconveniently imposing itself on outdoor patrons. For much of corporate America, changing their company's direction to reach their goals has meant converting traditional workforces to remote employees.

Posted January 18, 2022

The roots of open source go back to the original pioneers of the computer revolution. Early pioneers of computing at organizations such as Bell Labs and MIT held a belief that sharing program code was essential to the progression of computer technology.

Posted January 17, 2022

The ultimate goal of almost all enterprise technology is to automate manual activities into digital processes. BPM (business process management) and workflow systems have been used for decades, and, under the cover of most business applications, sit complex process, task, and workflow management. It is hard to define the sheer scale and breadth of process automation other than to say that it is pervasive. Indeed, although industry analysts love to slice and dice technologies into quadrant and wave silos, doing so with process automation technology is difficult and often, though not deliberately, misleading.

Posted January 17, 2022

Organizations, public and private, are codifying principles, regulations are emerging, and standards are proliferating.

Posted December 22, 2021

Graph databases are powerful new tools for managing and analyzing heterogeneous data across the enterprise. Most importantly, organizations are beginning tounderstand the specific use cases that graph databases solve well.

Posted December 15, 2021

With the combination of the PyData community and commercial software offerings (especially those accelerating Python's foundational components), as well as all the startups building solutions, there is a lot of momentum propelling Python forward.

Posted December 15, 2021

There are some words that you have never heard of and when you hear them for the first time—bam! From that instant, you hear them every day and read them everywhere. "Metaverse" is such a word. Today, the metaverse, long seen as a futuristic dream, is quickly becoming a reality. What it will become remains to be seen.

Posted December 15, 2021

The amount of data we use and manage doubles annually, and performing analytics on that data can uncover heretofore unknown insights that lead to competitive advantage.

Posted December 15, 2021

With heightened pressure to compete on analytics, the purpose and role of data architecture is coming into clearer focus to meet business operating necessities. Recently, John O'Brien, CEO and principal advisor of Radiant Advisors, talked with BDQ about the principles of a resilient enterprise data architecture and the enabling methodologies and technologies.

Posted November 11, 2021

Now is the time to put better strategies around edge implementations so they fit more safely and easily into the wider enterprise environment.

Posted November 11, 2021

In the rush to bring AI and data solutions to bear, don't guess and don't just ask, "Why?"; also ask, "Why not?" Consider why this application might not be a good idea, may not lead to our intended outcome, might not be well-received, and might not safeguard human dignity and liberties.

Posted September 27, 2021

The pandemic has shown clearly that the risk of doing nothing in digital is exceeding the risk of doing something. Now is the time to seize the opportunity to become the next digital rainmaker.

Posted September 27, 2021

Unlike their historical ancestors who carried out their acts during a violent war, these pirates of the information superhighway hone their skills so that they can attack remotely when war is imminent or whenever else they wish. They can use these cyberskills to disrupt key infrastructure such as a gas pipeline, a hospital, or other critical facets of an ever-narrowing and fragile supply chain. While they do not carry letters of marque, we know many are state-sponsored.

Posted September 27, 2021

The amount of data associated with networks is massive, especially when compared to the percentage of traffic that is actually malicious. There is just too much data to analyze in a single day, and this problem is compounded on a daily basis. Threat tactics are constantly changing, with events occurring at a higher frequency, which is forcing the network security industry to prepare for and react to any questionable situation. To make matters worse, cybersecurity specialists are in very high demand, and there is a limited pool of talent from which to draw.

Posted September 27, 2021

Today's data-driven organizations demand capabilities that adapt to the enterprise and open new paths of innovation to business users. Achieving leadership in today's economy requires identifying and preparing for the emerging technologies and methodologies that deliver transformation.

Posted September 27, 2021

Today, organizations need data-driven insights to advance decision making at all levels and digital transformation is a key component of those efforts. Supporting data-driven insights and digital transformation takes an ever-growing range of services, products, and tools from forward-thinking companies that are working to help their customers deliver the right insights to the right people at the right time.

Posted September 08, 2021

In the quest for digital transformation and the use of data to become "data-driven," data quality is taking on even greater importance than it ever has before. Recently, Tyler Warden, senior vice president, product and engineering, Syniti, shared his insights on how organizations can improve the quality of their data and, as a result, enable more informed decision making.

Posted August 24, 2021

Lynda Partner, senior vice president for products and offerings at Pythian, spoke at Data Summit Connect earlier this year about how to accelerate value with machine learning. In this interview with BDQ, Partner continues the conversation and highlights how to select the right use cases for ML, avoid mistakes, and manage an ML project once it becomes a reality.

Posted August 04, 2021

As enterprises rushed to digitize their offline assets over the past year, data finally won widespread recognition as the lifeblood of modern commerce. At a high level, data enabled pandemic-shocked businesses to comprehensively understand their changing landscapes, then generate actionable predictions for how demand would shift. There's little question that data has grown in importance every year, but in 2021, there's now no question that its value is crystal clear to virtually every enterprise.

Posted August 04, 2021

Founded by the creators of Apache Kylin, venture-backed Kyligence and is dual-headquartered in San Jose, California, and Shanghai, China. Luke Han, co-founder and CEO at Kyligence, recently explained the company's connection to the open source project, its future goals, where it fits into the global data management ecosystem, and how it plans to differentiate itself from competitors.

Posted June 08, 2021

Polyglot persistence, the practice of selecting the best database for the job, is on the rise. The days of the one-size-fits-all approach are gone as companies strongly embrace a range of NoSQL/NewSQL and relational, cloud and on-prem, and proprietary and open source options. With this trend, comes the opportunity to choose the right database for the job but also greater complexity.

Posted May 26, 2021

As restrictions caused by the pandemic begin to ease and a "new normal" for business comes into view, some organizations are emerging as winners. Key to thriving and not just surviving, many experts say, is the ability to use data more effectively, enabled by the well-applied use of the right database technologies and cloud resources as well as automation and AI.

Posted May 26, 2021

Everyone is talking about digital transformation and the new normal of working from home, which has inarguably brought cybersecurity threats to a new level. With the boundaries of the network parameter all but disappearing, the risks of an attack are greater than ever.

Posted May 26, 2021

Network security logs are a ubiquitous record of system runtime states and messages of system activities and events. Parsing logs with regular expressions is the most widely utilized method available for network log analysis. Providing a toolset powered by NLP to perform log parsing is a game changer in the critical and time-sensitive area of cybersecurity.

Posted May 26, 2021

As many people in the world pass through the eye of the pandemic storm, aspiring to survive and experience the sun again, another catastrophe looms—albeit barely visible. This potentially devastating problem lurks around the corner from the big-box store that may have just provided their COVID-19 vaccinations, but it is of a very different nature. We are facing a pending tsunami of automation.

Posted May 26, 2021

Empowering every data user starts with reassessing how we think people work with data. Too often, we think "data professionals" but hear "data scientists," "business analysts," and "power users."

Posted May 26, 2021

A new type of channel looms on the horizon for Customer 360 projects, and it is going to be the toughest one of all to achieve. In order to master it, customer experience needs to evolve to the next level—a level that can be thought of as the "connected customer experience." The channel? Connected products.

Posted May 26, 2021

Deploying AI fairly, safely, and responsibly requires clarity about the risks and rewards of an imperfect solution, not the attainment of perfection. An AI algorithm will make mistakes. The error rate may be equal to or lower than that of a human. Regardless, until data perfectly representing every potential state—past, current, and future—exists, even a perfectly prescient algorithm will err. Given that neither perfect data nor perfect algorithms exist, the question isn't whether errors will happen but instead: When, under what conditions, and at what frequency are mistakes likely?

Posted May 26, 2021

The move to next-generation databases is driven by their ability to help companies achieve competitiveness and reach customers faster and more efficiently. These new breeds of systems can be a force for business transformation—whether it is generating new sources of revenue, enhancing customer experience, or producing data-driven insights that improve how organizations interact with customers.

Posted May 26, 2021

In 2020, very few open source software projects remained truly "open" without a single company acting essentially as an owner. PostgreSQL and Debian are probably the last relics of the idealistic era of the 1980s and 1990s. Let's look at how and why the OSS market and the ownership of open source software projects have changed over time, and take a glimpse into what the future will bring as open source projects continue to mature and as adoption continues to rise.

Posted May 06, 2021

A few years ago, if you had asked a group of C-Level executives to project which software delivery trend would be more important for organizations, most would have ranked DevOps ahead of containers. DevOps promised to profoundly refocus and reenergize software teams while containers looked like an interesting new way to repackage resources that were already there. Today, the rankings have flipped.

Posted May 05, 2021

Data is a critical company asset that has continued to grow exponentially for over a decade. However, to create game-changing business value, data not only needs to be analyzed, but it needs to be utilized.

Posted April 15, 2021

In the future, 2021 may be viewed as a sharp turning point when companies recovered from the dramatic changes of 2020 and moved from surviving to thriving. Recently, John O'Brien, CEO and principal advisor, Radiant Advisors, spoke with BDQ about the challenges and opportunities for organizations as they emerge from the seismic shifts of the past year.

Posted April 09, 2021

After a wild and turbulent 2020, the new year has ushered in a renewed commitment to establishing or improving corporate governance. Yet, positive energy aside, our traditional approach to endorsing governance of data, analytics, or AI remains fraught. As a result, governance initiatives springing from an earnest desire to do right (e.g., responsible AI), as well as the need to not do wrong (e.g., regulatory/compliance), struggle to enlist broad coalitions of the willing.

Posted April 05, 2021

The full potential for companies that digitally transform is predicted to be $100 trillion by 2025. This astonishing value would be reached through the combination of digital technologies—mobile, cloud, AI, sensors, and analytics, among others. These are accelerating progress exponentially, said the World Economic Forum, but this growth can be realized only if there is collaboration between business, policymakers, and non-governmental organizations.

Posted April 05, 2021

As the world of data analytics continues to evolve and reshape after a tumultuous 2020, the need for agility is rapidly driving a new era in data culture in which it is imperative to handle data immediately and at scale. While emphasis on self-service data and analytics has been top-of-mind for some time now, the shift to self-sufficiency is held back by culture, not technology. With the new year pushing more robotics process automation at all levels of the business—and for all data users—organizations are becoming more acutely aware that true enablement isn't just about tools and tech. It's about people.

Posted April 05, 2021

The world changed over the last year. Future historians will complete their theses focusing on different quarters or even specific months of 2020. But one of the most overused cliches in thinking about this period of time has been the idea that "the more things change, the more they remain the same." Let's consider sports in 2020. Major League Baseball had a 60-game season, the NBA finals were played in October, and cardboard cutouts took the place of fans in every sport. However, the Lakers won the NBA finals, the Dodgers won the World Series with the Yankees playing deep into the playoffs, and Tom Brady went to his 10th Super Bowl. The more things change …

Posted April 05, 2021

Securing information systems and data is a foundation for any organization. Detection of insider threats can be a considerable challenge for threat detection systems and security analysts. This is due to the difficulty of determining non-normal actions from internal system behavior data.

Posted April 05, 2021

Today, the idea of picking up the phone to call a travel agent to plan out a vacation seems archaic. It used to be that everyone used a travel agent, but nowadays it's an occupation that caters mainly to the wealthy. Yet there was something about it that was uniquely valuable, something that the legions of vacation-planning websites and travel-booking apps—powered by oceans of data and cutting-edge algorithms—haven't been able to fully replicate.

Posted April 05, 2021

Multi-cloud is changing the way we manage data. It's seen as a way to build a more resilient diversity of services while ensuring a greater degree of independence from a single vendor. At the same time, it takes skill to get everything aligned. In recent years, multi-cloud has become a popular approach, with 93% of enterprises using a multi-cloud strategy, according to the latest Flexera/RightScale survey on cloud adoption. The survey found that respondents use an average of 2.2 public and 2.2 private clouds.

Posted April 02, 2021

Conventional data management systems are fundamentally ill-suited for the world of data as it exists today. These systems, based with few exceptions on the relational data model, are broken because they integrate based on data location at the storage layer. While this approach worked reasonably well for the past 25 years, the world today has far too much data to use data location in storage as the basic lever.

Posted April 02, 2021

Data may be at the heart of all digital engagements, but most enterprises are still behind the curve when it comes to effectively identifying and managing it. That's the takeaway from the latest survey of 419 enterprise executives from BARC, which finds continuing challenges with identifying and surfacing the data assets needed to succeed in today's digital economy.

Posted April 02, 2021

Faster decision making enabled by access to role-appropriate information is the goal of organizations striving to become data-driven. At the same time, there is strong pressure on companies to ensure data quality and trustworthiness, as well as to maintain data security to avoid breaches and risk regulatory non-compliance.

Posted April 02, 2021

Ben Sharma, co-founder and chief product officer of Zaloni, spoke with BDQ about the challenges companies are facing in their efforts to gain value from data.

Posted March 11, 2021

VMware has announced portfolio updates to help customers modernize their applications and infrastructure, including new releases of vSphere 7 and vSAN 7 to help IT teams support new and existing applications with infrastructure that is developer and AI-ready.

Posted March 09, 2021

In 2020, companies across every industry were impacted by the COVID-19 pandemic. As a result, many new business models emerged, including curbside deliveries, contactless-service, and virtual fitness training, to name a few. With 2021 well underway, let's take a look at the new business and technology habits that we can expect to endure even after the pandemic is over.

Posted March 08, 2021

Pages
1
2
3
4
5
6
7
8
9
10
11
12
13

Newsletters

Subscribe to Big Data Quarterly E-Edition