https://insidebigdata.com/tag/lakehouse/ Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies Wed, 18 Oct 2023 17:37:57 +0000 en-US hourly 1 https://wordpress.org/?v=6.3.2 136462205 https://insidebigdata.com/2023/10/21/research-highlights-dremio-demonstrates-data-lakehouse-value-with-math-style-proof-and-technical-clarity/ https://insidebigdata.com/2023/10/21/research-highlights-dremio-demonstrates-data-lakehouse-value-with-math-style-proof-and-technical-clarity/#comments Sat, 21 Oct 2023 10:00:00 +0000 https://insidebigdata.com/?p=33702 Dremio, the easy and open data lakehouse, has published "The Data Lakehouse: Data Warehousing and More," a novel research paper now available on arXiv. The paper explores the data lakehouse model, offering modern insights for businesses looking to optimize their data utilization. The idea through this preprint publication is to gather feedback from the open source research and scientific community and make it available to the wider community of practitioners.]]> https://insidebigdata.com/2023/10/21/research-highlights-dremio-demonstrates-data-lakehouse-value-with-math-style-proof-and-technical-clarity/feed/ 1 33702 https://insidebigdata.com/2023/06/27/cloudera-expands-open-data-lakehouse-for-trusted-enterprise-ai/ https://insidebigdata.com/2023/06/27/cloudera-expands-open-data-lakehouse-for-trusted-enterprise-ai/#respond Tue, 27 Jun 2023 13:00:00 +0000 https://insidebigdata.com/?p=32724 Cloudera, the hybrid data company, announced today an expansion of its Open Data Lakehouse offerings enabling customers to have a foundation for analytic and AI capabilities in their enterprises for all their data - in the cloud and now on-premises. Cloudera was an early proponent of Apache Iceberg, introducing support in its CDP-Public Cloud offering last year and recently rolling out support for Iceberg V2.  Today, Cloudera is announcing support for Apache Iceberg for CDP-Private Cloud, available now as a tech preview and with General Availability later this summer.  Cloudera delivers Iceberg everywhere customer data resides facilitating innovation anywhere.]]> https://insidebigdata.com/2023/06/27/cloudera-expands-open-data-lakehouse-for-trusted-enterprise-ai/feed/ 0 32724 https://insidebigdata.com/2023/03/07/databricks-launches-simplified-real-time-machine-learning-for-the-lakehouse/ https://insidebigdata.com/2023/03/07/databricks-launches-simplified-real-time-machine-learning-for-the-lakehouse/#respond Tue, 07 Mar 2023 15:00:00 +0000 https://insidebigdata.com/?p=31820 Databricks, the lakehouse company, announced the launch of Databricks Model Serving to provide simplified production machine learning (ML) natively within the Databricks Lakehouse Platform. Model Serving removes the complexity of building and maintaining complicated infrastructure for intelligent applications. Now, organizations can leverage the Databricks Lakehouse Platform to integrate real-time machine learning systems across their business, from personalized recommendations to customer service chatbots, without the need to configure and manage the underlying infrastructure.]]> https://insidebigdata.com/2023/03/07/databricks-launches-simplified-real-time-machine-learning-for-the-lakehouse/feed/ 0 31820 https://insidebigdata.com/2022/11/03/video-highlights-modernize-your-ibm-mainframe-netezza-with-databricks-lakehouse/ https://insidebigdata.com/2022/11/03/video-highlights-modernize-your-ibm-mainframe-netezza-with-databricks-lakehouse/#respond Thu, 03 Nov 2022 13:09:00 +0000 https://insidebigdata.com/?p=30797 In the video presentation below, learn from experts how to architect modern data pipelines to consolidate data from multiple IBM data sources into Databricks Lakehouse, using the state-of-the-art replication technique—Change Data Capture (CDC).]]> https://insidebigdata.com/2022/11/03/video-highlights-modernize-your-ibm-mainframe-netezza-with-databricks-lakehouse/feed/ 0 30797 https://insidebigdata.com/2022/10/15/cloudera-continues-rapid-pace-of-data-fabric-and-data-lakehouse-innovation-to-extend-data-management-leadership/ https://insidebigdata.com/2022/10/15/cloudera-continues-rapid-pace-of-data-fabric-and-data-lakehouse-innovation-to-extend-data-management-leadership/#respond Sat, 15 Oct 2022 13:00:00 +0000 https://insidebigdata.com/?p=30633 Cloudera, the hybrid data company, announced new hybrid data capabilities that enable organizations to more efficiently move data, metadata, data workloads and data applications across clouds and on premises to optimize for performance, cost and security. Cloudera’s portable data services enable simple, low-risk data workload and data application movement for ultimate data lakehouse optionality.]]> https://insidebigdata.com/2022/10/15/cloudera-continues-rapid-pace-of-data-fabric-and-data-lakehouse-innovation-to-extend-data-management-leadership/feed/ 0 30633 https://insidebigdata.com/2022/08/17/cloudera-launches-all-in-one-data-lakehouse-cloud-service/ https://insidebigdata.com/2022/08/17/cloudera-launches-all-in-one-data-lakehouse-cloud-service/#respond Wed, 17 Aug 2022 14:00:00 +0000 https://insidebigdata.com/?p=30114 Cloudera, the hybrid data company, announced the launch of Cloudera Data Platform (CDP) One, an all-in-one data lakehouse software as a service (SaaS) offering that enables fast and easy self-service analytics and exploratory data science on any type of data. A simple yet powerful cloud service, only CDP One has built-in enterprise security and machine learning (ML) that requires zero cloud, security or monitoring operations staff for lower TCO and reduced risk. ]]> https://insidebigdata.com/2022/08/17/cloudera-launches-all-in-one-data-lakehouse-cloud-service/feed/ 0 30114 https://insidebigdata.com/2022/07/02/databricks-announces-major-contributions-to-flagship-open-source-projects/ https://insidebigdata.com/2022/07/02/databricks-announces-major-contributions-to-flagship-open-source-projects/#respond Sat, 02 Jul 2022 13:00:00 +0000 https://insidebigdata.com/?p=29715 Databricks announced that the company will contribute all features and enhancements it has made to Delta Lake to the Linux Foundation and open source all Delta Lake APIs as part of the Delta Lake 2.0 release. In addition, the company announced MLflow 2.0, which includes MLflow Pipelines, a new feature to accelerate and simplify ML model deployments. Finally, the company introduced Spark Connect, to enable the use of Spark on virtually any device, and Project Lightspeed, a next generation Spark Structured Streaming engine for data streaming on the lakehouse. ]]> https://insidebigdata.com/2022/07/02/databricks-announces-major-contributions-to-flagship-open-source-projects/feed/ 0 29715 https://insidebigdata.com/2022/04/06/databricks-announces-general-availability-of-delta-live-tables/ https://insidebigdata.com/2022/04/06/databricks-announces-general-availability-of-delta-live-tables/#respond Wed, 06 Apr 2022 13:00:00 +0000 https://insidebigdata.com/?p=28936 Databricks, the Data and AI company and pioneer of the data lakehouse paradigm, announced the general availability of Delta Live Tables (DLT), the first ETL framework to use a simple declarative approach to build reliable data pipelines and to automatically manage data infrastructure at scale. Turning SQL queries into production ETL pipelines often requires a lot of tedious, complicated operational work. By using modern software engineering practices to automate the most time consuming parts of data engineering, data engineers and analysts can concentrate on delivering data rather than on operating and maintaining pipelines.]]> https://insidebigdata.com/2022/04/06/databricks-announces-general-availability-of-delta-live-tables/feed/ 0 28936 https://insidebigdata.com/2022/03/02/dremio-announces-open-and-forever-free-lakehouse-platform-dremio-cloud-in-partnership-with-aws/ https://insidebigdata.com/2022/03/02/dremio-announces-open-and-forever-free-lakehouse-platform-dremio-cloud-in-partnership-with-aws/#respond Wed, 02 Mar 2022 14:00:00 +0000 https://insidebigdata.com/?p=28606 Dremio, the lakehouse company, announced the general availability of Dremio Cloud, the free data lakehouse platform and the addition of two new services: Dremio Sonar, a lakehouse engine built for SQL, and Dremio Arctic, a metadata and data management service for Apache Iceberg that provides a unique Git-like experience for the lakehouse. Dremio Sonar is now generally available, and Dremio Arctic is in public preview.]]> https://insidebigdata.com/2022/03/02/dremio-announces-open-and-forever-free-lakehouse-platform-dremio-cloud-in-partnership-with-aws/feed/ 0 28606