Open-source News

Hosted under the Linux Foundation to expand community with neutral governance model

San Francisco, CA, SEPTEMBER 23, 2019 – The Linux Foundation, the nonprofit organization enabling mass innovation through open source, today announced that Presto, the widely adopted interactive data query engine, will be hosted under the Linux Foundation. The newly-established Presto Foundation will have an open and neutral governance model that will enable Presto to scale and diversify its community. Founding members include Facebook, Alibaba, Twitter and Uber, who will use the foundation to enable contributors to drive the future direction of the project, helping Presto become the fastest and most reliable SQL engine for massively distributed data processing.

Presto was developed at Facebook in 2012 as a high-performance distributed SQL query engine for large scale data analytics. Presto’s architecture allows users to query a variety of data sources such as Hadoop, S3, Alluxio, MySQL, PostgreSQL, Kafka, MongoDB and move at scale and speed. It solves the problem of having to choose between having fast analytics that use an expensive commercial solution or using a slow but “free” solution that require excessive hardware.

“Presto has been designed for high performance exabyte-scale data processing on a large number of machines. Its flexible design allows processing data from a wide variety of data sources. From day one Presto has been designed with efficiency, scalability, and reliability in mind, and it has been improved over the years to take on additional use cases at Facebook, such as batch and other application specific interactive use cases.” said Nezih Yigitbasi, Engineering Manager of Presto at Facebook.

“At Facebook alone, over a thousand employees use Presto, running several million queries and processing petabytes of data per day. After creating Presto we open sourced it to see if other companies were having the same issues and wanted to collaborate. It turns out many other companies were interested and so under The Linux Foundation, we believe the project can engage others and grow the community for the benefit of all.”  said Kathy Kam, Head of Open Source at Facebook.

“The Linux Foundation is excited to work with the Presto community, collaborating to solve the increasing problem of massive distributed data processing at internet scale,“ said Michael Dolan, VP of Strategic Programs at the Linux Foundation.”

Presto Foundation will operate under a community governance model with representation from each of the founding members. With this evolution Facebook will be collaborating with the broader ecosystem of users and contributors as one voice in the future of the Foundation.

Presto is a distributed system designed to run on large clusters of machines. It can query data where it is stored without needing to move the data to a separate system. Its in-memory and distributed query processing results in query latencies of seconds to minutes.

Additional quotes

“Uber’s data platform architecture uses Presto to extract critical insights from aggregated data, which helps us build better products for our customers,” says Brian Hsieh, Head of Open Source at Uber. “Uber is honored to partner with the Linux Foundation and major contributors from the tech community to bring the Presto Foundation to life. Our goal is to help create an open and collaborative community in which Presto developers can thrive.”

“Alibaba Group is pleased to participate in this exciting project of the Linux Foundation, with our abundant business scenarios as well as the talented developer team,” says Liang Lin, Senior Director of Alibaba OLAP products. “We believe the collaboration would eventually benefit both the community as well as Alibaba and our customers.”

For more information please visit http://prestodb.github.io/

 

About The Linux Foundation

Founded in 2000, the Linux Foundation is supported by more than 1,000 members and is the world’s leading home for collaboration on open source software, open standards, open data, and open hardware. Linux Foundation’s projects are critical to the world’s infrastructure including Linux, Kubernetes, Node.js, and more.  The Linux Foundation’s methodology focuses on leveraging best practices and addressing the needs of contributors, users and solution providers to create sustainable models for open collaboration. For more information, please visit us at linuxfoundation.org.

The Linux Foundation has registered trademarks and uses trademarks. For a list of trademarks of The Linux Foundation, please see its trademark usage page: www.linuxfoundation.org/trademark-usage. Linux is a registered trademark of Linus Torvalds.

Media Contact
Beth Handoll
ReTHINKitMedia
beth@rethinkitmedia.com
+1 415 535 8658

The post Facebook, Uber, Twitter and Alibaba form Presto Foundation to Tackle Distributed Data Processing at Scale appeared first on The Linux Foundation.

Linux expands its LF Edge collective with new projects  IT PRO

LF Edge, the Linux Foundation's organisation to promote an open framework for edge computing, has announced that two new projects will be added to its ...

Best Linux distros of 2019: for beginners and advanced users  TechRadar

There are a lot of variants of Linux, so here we feature the best distros for either beginners or more advanced Linux users.

Best Linux distros of 2019: for beginners and advanced users  TechRadar

There are a lot of variants of Linux, so here we feature the best distros for either beginners or more advanced Linux users.

Best Linux distros of 2019: for beginners and advanced users  TechRadar

There are a lot of variants of Linux, so here we feature the best distros for either beginners or more advanced Linux users.

While AMD has provided open-source Radeon RX 5700 series (Navi 10) support since launch and that code since worked into the various mainline code-bases from the Linux kernel to Mesa, one kink in their support has been their binary microcode images not being available from the reference linux-firmware.git location as needed to initialize the hardware. That Navi 10 firmware/microcode issue has finally been rectified with the images landing this morning...

• Open industry taskforce developing common NFVI as industry moves toward 5G
• Common model and related first architecture enables the building of operationally efficient open source SDN and NFV infrastructures
• Supports LF Networking’s evolving compliance and verification program (OVP) using OPNFV Test Automation 

 

ANTWERP, Belgium – Open Networking Summit Europe – September 23, 2019 – LF Networking (LFN) and the GSMA today announced that the Common NFVi Telco Taskforce (CNTT) has reached its first major milestone with the publication of its initial common Reference Model and first Reference Architecture. Jointly hosted by the GSMA and the Linux Foundation, CNTT operates as an open committee responsible for creating and documenting an industry-aligned Common NFVI Framework. 

“This initial release represents the first tangible output of CNTT,” said Heather Kirksey, vice president, Community and Ecosystem Development, the Linux Foundation. “In the short time since ONS North America, the community has already reached milestones around creation of the Reference Model and first Reference Architecture. We have also initiated significant discussion around Reference Implementation along with commencement of enhancements to OVP within OPNFV.  I am very pleased to see the focused delivery of this group and our ability to align the industry and accelerate innovation, especially in the advance of 5G. It’s incredible to witness such deep collaboration and integration among operators and vendors from across the globe.”

“The speed with which this group has been established and produced its first tangible results are testament to the close cooperation and collaboration of its industry members,” said Alex Sinclair, Chief Technology Officer, GSMA. “A common framework and approach will accelerate adoption and deployment in the 5G era and we look forward to aligning further with our partners on this important project.” 

Initially organized early in 2019, CNTT held its first community-wide, face-to-face gathering in Paris this July, with more than 80 operator and vendor participants in attendance; the successful three-day event enabled collaborative discussion on next steps.

Following that initial meeting, the CNTT is working closely with taskforce members to refine the  NFVI Reference Model, define a limited number of Reference Architectures, develop testing and verification requirements, and work with the OPNFV Verification Program (OVP) to define a global VNF compliance and validation lifecycle. This work will shorten the on-boarding effort for VNFs, accelerate time to revenue, and reduce costs for both VNF vendors and operators. Relying on a ground breaking collaborative model between the GSMA, the Linux Foundation, and the telecommunications vendor ecosystem, the group is creating a suite of tangible specifications to be hosted by the GSMA, and code to be created and hosted within OPNFV.  

Preliminary documentation — including the first Reference Model — are available in CNTT GitHub repository  

• Guiding Principles
• Intent to Realize requirements from operators (such as testing)
• Outline of GSMA-hosted specifications that support open source work from OPNFV
• Preliminary Reference Model
• A set of Reference Architectures based on the Reference Model with specific workload profiles for different cloud platforms.
• Inputs into Lab-As-A Service and other Lab and CI/CD Infrastructure projects of OPNFV and LFN

Alignment with OVP

CNTT is an enhancer to  OVP, an open source, community-led compliance and verification program that demonstrates the readiness and availability of commercial NFV products and services, including NFVI and VNFs, using OPNFV and ONAP. OVP combines open source-based automated compliance and verification testing for multiple parts of the NFV stack specifications established by ONAP, multiple SDOs such as ETSI and GSMA, and the LF Networking End User Advisory Group (EUAG). 

Once CNTT Reference Models and Architectures are implemented and tested via OPNFV (Reference Implementations), commercial products adhering to these specifications can undergo an enhanced OVP’s VNF and NFVI compliance testing for establishing baseline conformance and offering interoperability. 

The OVP work continues to advance. There will be a dedicated OVP hacking track at the next LFN DDF + Plugfest to facilitate VNF vendor onboarding and testing. Anyone interested in any aspect of the program — including testing their VNFs — is encouraged to get involved and attend an introductory webinar with SDx Central: “How the OPNFV Verification Program (OVP) Can Boost VNF Interoperability” on October 22.  Information on the existing 11 OPNFV Verified products to date is available here: https://nfvi-verified.lfnetworking.org/#/ 

Looking ahead

CNTT will continue to further refine its Reference Model and its first Reference Architecture based on Openstack, and expand its portfolio of Reference Architectures with an upcoming focus on areas such as Containerization, Kubernetes-based Cloud Native stacks and Container based network functions’ validation requirements, along with growing its capabilities surrounding compliance and verification testing, and providing a lifecycle approach for NFVI. GSMA and OPNFV look forward to continuing the open source definition and implementation work that powers the community and ecosystem, so that these new technologies can be integrated into global service provider networks. 

Community Support

AT&T
“Since its formation earlier this year, the CNTT community has made tremendous progress in building out the foundational elements of a NFVI and VFN lifecycle framework, as well as creating alignment on a discrete, compliant and verified set of NFV infrastructures for the telco ecosystem,” said Mark Cottrell, assistant vice president, Network Cloud, AT&T Labs. “By delivering on this promise, CNTT will simplify VNF development, bringing compliant and verified VNFs to the marketplace more quickly.”

China Mobile
“Common NFVI helps NFV deployment via true decoupling between the virtual layer and the application layer. It is motivated to reduce resource fragmentation and vendor binding. Given this goalit is important to have both infrastructure and application vendors closely collaborate to truly realize productization based on standard resource specifications. We look forward to promoting the development, implementation and certification of this standard through the cooperation between GSMA and LFN.” Said, Dr. Junlan Feng, Chief Scientist at China Mobile Research Institute, General Manager of AI & Intelligent Operation R&D Center.

Ericsson
Anders Rosengren, Head of Architecture and Technology, Ericsson Digital Services states, “Ericsson is one of the leading contributors of code to many open source projects and also leading contributor to OPNFV from beginning including driving common NFVI architecture and seeking alignment with standard bodies and open source community. We have been working with OVP certification process and Ericsson Cloud Execution environment (CEE) is OVP certified. As 5G networks are beginning to be deployed, a common NFVI is key both in the central data center and also in the Edge data centers. Ericsson will continue to support the open source initiatives such as CNTT, its continuous improvements and verification program including the VNF verification.”

Globe Telecom
“The promise of NFV was compelling for global operators,” said Vincent Seet, head, Enterprise Architecture, Globe Telecom. “The opportunity to more efficiently utilize networks through virtualization and other open source technologies was and still is compelling. However, what the communities didn’t anticipate and have yet to conquer is the overall integration complexity and challenge. It’s great to see that so many organizations are collaborating on the CNTT to directly address the challenge and help move the industry forward.”

Intel
“A set of common NFVi reference architectures, supported with a strong compliance and verification test suites are absolutely critical to drive the next phase of Network Transformation which is fundamental to usher in the promise of edge computing and 5G,“ said Rajesh Gadiyar,vice president and chief technology officer of the Network and Customs Logic Group atIntel. “An agile NFV stack built on cloud principles with the CNTT reference architecture is pivotal and will accelerate innovation and deployment of new services.”

Nokia
“Nokia welcomes the Common NVFI Taskforce (CNTT) activity initiated by GSMA together with LNF to build an industry-aligned NFV infrastructure framework,” said Ron Haberman, CTO of Nokia Software.  “As an active participant in OPNFV and the OPNFV Verification program (OVP), Nokia is delighted a broader industry-backed task force has been formed to focus on a common NFVI framework. Having participated in hundreds of cloud infrastructure and NFV deployments, involving Network and IT workloads across a broad set of vendors, we know how critical predictable performance from the NFVI is for production networks and services.  Lowering implementation obstacles, like commissioning the correct infrastructure for the task, should add momentum to NFV adoption and the 5G evolution.”

Orange
“Specifying reference NFV infrastructure benefits all parties in the integration chain. We are very pleased the industry at large is now recognizing the benefit, and is embarking into the CNTT initiative. Progress since ONS Europe last year has been tremendous,” said Stéphane Demartis, VP Cloud Infrastructure Solutions and Services, Orange.

Verizon
“From the beginning I saw the value of the work that CNTT is doing as a way to speed the integration of our VNF vendors into our next generation infrastructure,” said  Beth Cohen, SDN Products, Verizon.

Vodafone
“The CNTT empowered by an industry driven compliance and certification programme means  less need for internal testing of VNFs before onboarding them into our network and hence allowing us to introduce new services to our customers faster,” said Markus Wuepping, Head of Cloud Center of Excellence, Vodafone Group.

About the Linux Foundation
The Linux Foundation is the organization of choice for the world’s top developers and companies build ecosystems that accelerate open technology development and commercial adoption. Together with the worldwide open source community, it is solving the hardest technology problems by creating the largest shared technology investment in history. Founded in 2000, The Linux Foundation today provides tools, training and events to scale any open source project, which together deliver an economic impact not achievable by any one company. More information can be found at www.linuxfoundation.org.

# # #
The Linux Foundation has registered trademarks and uses trademarks. For a list of trademarks of The Linux Foundation, please see our trademark usage page: https://www.linuxfoundation.org/trademark-usage. Linux is a registered trademark of Linus Torvalds.

 

The post Operator-Led Effort Hosted by Linux Foundation and GSMA publishes Initial Specifications for Common NFV Infrastructure, Empowered by LFN’s OVP Framework appeared first on The Linux Foundation.

Jiri Kosina on Sunday sent out the HID subsystem updates for the in-development Linux 5.4 kernel. The HID pull once again features support for several new devices particularly on the Logitech side...

Linux 5.4 Brings Support For Wacom's MobileStudio Pro 13, Logitech Lightspeed Receivers  Phoronix

Jiri Kosina on Sunday sent out the HID subsystem updates for the in-development Linux 5.4 kernel. The HID pull once again features support for several new ...

The Lima Gallium3D driver for supporting Arm Mali 400/450 graphics hardware within Arm SoCs has picked up a few performance optimizations...

Back in August I noted that Wireless USB and Ultra Wideband would be deprecated within the Linux kernel and that is indeed happening for Linux 5.4...

Filesystem quota is a standard built-in feature found in Linux Kernel. Quotas determine the amount of space a file should have to support user activities. The disk quotas also limit the number of files...

In a recent article, I introduced the chown command, which is used for modifying ownership of files on systems. Recall that ownership is the combination of the user and group assigned to an object. The chgrp and newgrp commands provide additional help for managing files that need to maintain group ownership.

read more

Data science is an exciting new field in computing that's built around analyzing, visualizing, correlating, and interpreting the boundless amounts of information our computers are collecting about the world. Of course, calling it a "new" field is a little disingenuous because the discipline is a derivative of statistics, data analysis, and plain old obsessive scientific observation.

read more

AMD Navi 10 Firmware Finally Lands In The Linux-Firmware Tree  Phoronix

Operator-Led Effort Hosted by Linux Foundation and GSMA publishes Initial Specifications for Common NFV Infrastructure, Empowered by LFN's OVP Framework  PRNewswire

Best Linux distros of 2019: for beginners and advanced users  TechRadar

In my article Mutation testing is the evolution of TDD, I exposed the power of iteration to guarantee a solution when a measurable test is available. In that article, an iterative approach helped to determine how to implement code that calculates the square root of a given number.

read more

DragonFlyBSD's now-default HAMMER2 file-system now has initial file-system checking "fsck" support...

Linux-Powered BeagleBoard AI Comes With Debian Out-of-the-box  Fossbytes

Linux powered BeabgleBoard AI Single Board Computer (SBC) has been launched by the BeagleBoard foundation at a $125 price tag. The new SBC uses ...