Open-source News

Linux Foundation to Host the PaSh Project, Accelerating Shell Scripting with Automated Parallelization for Industrial Use Cases

The Linux Foundation - Tue, 09/21/2021 - 23:05

Rooted in academia, the PaSh project prepares for industrial adoption

SAN FRANCISCO, Calif., September 21, 2021 — The Linux Foundation, the nonprofit organization enabling mass innovation through open source, today announced it will host the PaSh project. PaSh is a system for automatically parallelizing POSIX shell scripts that optimizes programs and speeds up execution times, leading to faster results for data scientists, engineers, biologists, economists, administrators, and programmers.

The project is supported by MIT, Rice University, Stevens Institute of Technology, and the University of Pennsylvania and governed by a Technical Steering Committee that includes Nikos Vasilakis, research scientist at MIT; Michael Greenberg, assistant professor at Stevens Institute of Technology; and Konstantinos Kallas, Ph.D. student at University of Pennsylvania.

“The Linux Foundation offers the technical governance infrastructure and services that PaSh has come to require as it has become more mature,” said Nikos Vasilakis, Technical Steering Committee chair for the PaSh Project. “We created the project to improve upon and accelerate the execution of shell scripts in the face of new web crawling, indexing and natural language processing changes.”

Konstantinos Kallas, Technical Steering Committee member for the PaSh project, adds “PaSh has received significant attention from the academic community and has the potential for an outsized impact in industry today, due to several synergistic trends. This is the right move at the right time.”

The techniques underpinning the project have gathered several awards, including a best paper award at the 16th edition of the EuroSys conference and a graduate research award for Konstantinos by the Association of Computing Machinery.

From succinct data wrangling and everyday processing to system orchestration and administration, shell scripting—the ever-present glue holding commands developed in different languages  together—forms the backbone of today’s computing userspace. PaSh parallelizes shell scripts, achieving significant performance improvements. On modern multiprocessor computers, PaSh can execute tasks like web crawling and indexing, COVID19-related analyses, natural-language processing, and other workloads in a fraction of their original time with minimal-to-zero developer effort.

“Shell scripts have been used pervasively for half a century, and recent trends towards ‘containerization’ have only increased their importance,” said Michael Greenberg, Technical Steering Committee member for the PaSh Project. “The correct and automated parallelization of shell scripts has been an issue for several decades. PaSh promises a speed boost to shell users of all stripes.”

To accelerate shell scripts, PaSh provides a source-to-source parallelizing compiler, a program that takes as input a programmer’s shell script and returns a new program that is significantly faster than the original program. Since PaSh is source-to-source, it allows the optimized shell script to be inspected and executed using the same tools, in the same environment, and with the same data as the original script. A small runtime library and associated annotations on programs commonly used in shell scripts complete the picture, providing the PaSh compiler with high-performance primitives and supporting its key functions.

“The PaSh Project represents innovation in computer science and open source software,” said Mike Dolan, general manager and senior vice president of Projects at the Linux Foundation. “As software development evolves to address machine learning, containerization, artificial intelligence and more, PaSh shows up to support developers and data scientists who need more out of their scripting tools. We’re happy to be able to host this important work at Linux Foundation, a natural home for a project like this.”

To learn more and to get involved in the PaSh project, please visit http://binpa.sh/

About the Linux Foundation

Founded in 2000, the Linux Foundation is supported by more than 1,000 members and is the world’s leading home for collaboration on open source software, open standards, open data, and open hardware. Linux Foundation’s projects are critical to the world’s infrastructure including Linux, Kubernetes, Node.js, and more. The Linux Foundation’s methodology focuses on leveraging best practices and addressing the needs of contributors, users and solution providers to create sustainable models for open collaboration. For more information, please visit us at linuxfoundation.org

###

The Linux Foundation has registered trademarks and uses trademarks. For a list of trademarks of The Linux Foundation, please see our trademark usage page: https://www.linuxfoundation.org/trademark-usage. Linux is a registered trademark of Linus Torvalds.

Media Contact

Jennifer Cloer
Story Changes Culture
503-867-2304
jennifer@storychangesculture.com

The post Linux Foundation to Host the PaSh Project, Accelerating Shell Scripting with Automated Parallelization for Industrial Use Cases appeared first on Linux Foundation.

Samba 4.15 Released With Improved CLI Experience, Modernized VFS Interface

Phoronix - Tue, 09/21/2021 - 20:40
While there is now KSMBD with Linux 5.15 for offering an in-kernel SMB file server, its scope is much more limited than that of the Samba project in user-space. With that said, Samba 4.15 is out now with its latest batch of features and improvements for open-source SMB/CIFS support on Linux and other platforms...

Canonical Extending Ubuntu 14.04/16.04 LTS Support To Ten Years

Phoronix - Tue, 09/21/2021 - 20:00
Canonical is announcing this morning they are extending the Ubuntu 14.04 LTS "Trusty Tahr" and Ubuntu 16.04 LTS "Xenial Xerus" releases to a ten year lifespan...

The Linux Foundation Announces Agenda and Speaker Lineup for the 2021 Linux Foundation Member Summit

The Linux Foundation - Tue, 09/21/2021 - 20:00

This by-invitation event for Linux Foundation member organizations fosters collaboration, innovation, and partnerships among the leading projects and organizations working to drive digital transformation with open technologies.


SAN FRANCISCO, September 21, 2021The Linux Foundation, the nonprofit organization enabling mass innovation through open source, today announced the agenda and speaker lineup for the 2021 Linux Foundation Member Summit (LFMS), taking place November 2-4 at the Silverado Resort in Napa Valley, California. The keynote speakers can be viewed here and the full schedule can be viewed here.

LFMS, (formerly Open Source Leadership Summit), is a by-invitation event for Linux Foundation member organizations, where technical and business leaders convene to drive digital transformation and learn how to collaboratively manage the largest shared technology investment of our time. LFMS is a must-attend event for those looking to advance open source strategy, implementation and investment.

“Open source technology continues to show its strength and value to businesses across many different verticals and sectors, as well as its impact on the bottom line”, says Jim Zemlin, Executive Director, The Linux Foundation. “Our Member Summit is an opportunity for the best and brightest technical, business and community leaders to come together and share their valuable insights and experiences and to collaborate on important open source technology innovation.”

Keynote Speakers Include:

  • Josh Aas, Executive Director, Internet Security Research Group discussing Prossimo
  • Brian Christian, Author, “The Alignment Problem: Machine Learning and Human Values” & “The Most Human Human“; Co-author of “Algorithms to Live By” sharing on the intersection of AI and humanity   
  • Gabriele Columbro, Executive Director, Fintech Open Source Foundation providing project updates
  • Colin Eberhardt, Technology Director, Scott Logic discussing WebAssembly
  • Ali Fenn, President, ITRenew talking about circular data centers
  • Jennifer Fernick, SVP & Global Head of Research, NCC Group and Dr. David A. Wheeler, Director of Open Source Supply Chain Security, The Linux Foundation discussing OpenSSF
  • Luke Hinds, Security Engineering Lead, CTO Office, Red Hat sharing on sigstore
  • Sumer Johal, Executive Director, AgStack Foundation providing project updates
  • Kim Lewandowski, Product, Stealth Startup discussing the SLSA framework
  • Dan Lorenc, Software Engineer, Google sharing on the state of OSS Supply Chain Security
  • Gary O’Neall, CEO, Source Auditor Inc. and Kate Stewart, VP, Dependable Embedded Systems, The Linux Foundation discussing SPDX
  • Calista Redmond, CEO, RISC-V International talking about open hardware
  • Liz Rice, Chief Open Source Officer, Isovalent discussing cloud native security
  • Jon Stine, Executive Director, The Open Voice Network providing project updates
  • Jenny Wanger, Director of Programs, LF Public Health providing project updates
  • Jim Zemlin, Executive Director, The Linux Foundation providing foundation updates

Session Highlights:

  • The Coming Culture Challenges for Open Source Projects – Stephen Walli, Microsoft
  • The Importance of DEIA (Diversity, Equity, Inclusion, Accessibility) in Open Source – Anni Lai, Futurewei; Priyanka Sharma, CNCF; Tina Tsou, Arm; and Arun Gupta, Apple
  • Pandemic Pivots of an OSPO – Nithya Ruff, Comcast
  • The Prometheus Story: How a Side Project Became the Global Market Leader – Richard Hartmann, Grafana Labs
  • Trademarks and Open Source – Daniel Scales, The Linux Foundation
  • We Are Many, but We Are One – Tracy Miranda, Continuous Delivery Foundation; Sharon Jerop Kipruto, Google; Priti Desai, IBM; Christie Wilson, Google; and Kara de la Marck, CloudBees


Attend

Attendance to The Linux Foundation Member Summit is limited to members of The Linux Foundation, as well as to governing board members of LF Projects, media, speakers and sponsors. Invitation codes have been sent to member organization representatives. If you already have an invitation code, please go ahead and register here. If you do not, you may contact us for more information on attendance opportunities.

Sponsor
The Linux Foundation Member Summit is made possible thanks to our sponsors, including Co-Hosts: Google and TARS Foundation, Reception Sponsor: Cloud Native Computing Foundation, Lunch Sponsors: AWS and Oracle, Breakfast and Breaks Sponsors: Dell Technologies, IBM and VMware and Supporter: Indeed.

If you are not an LF member company, but would like to attend The Linux Foundation Member Summit, sponsoring it is an excellent opportunity to gain additional access to the event and its attendees for strategic discussions and collaboration. Learn more here

Press
Members of the press who would like to request a press pass to attend should contact Kristin O’Connell.

Health and Safety
Attendees will be required to be fully vaccinated against the COVID-19 virus and will need to wear a mask while onsite and comply with all on-site health measures, in accordance with The Linux Foundation Code of Conduct. To learn more, visit the Health & Safety webpage and read our blog post.

Travel Funding
The Linux Foundation’s Travel Fund is accepting applications, to enable those to join the event who might otherwise not be able to due to a lack of funding. We place an emphasis on funding applicants who are from historically underrepresented or untapped groups and/or those of lower socioeconomic status. Note that you must have an invitation to the event in order to apply for travel funding. To learn more and apply, click here.

About the Linux Foundation
Founded in 2000, the Linux Foundation is supported by more than 2,000 members and is the world’s leading home for collaboration on open source software, open standards, open data, and open hardware. Linux Foundation’s projects are critical to the world’s infrastructure, including Linux, Kubernetes, Node.js, and more. The Linux Foundation’s methodology focuses on leveraging best practices and addressing the needs of contributors, users and solution providers to create sustainable models for open collaboration. For more information, please visit linuxfoundation.org.

The Linux Foundation Events are where the world’s leading technologists meet, collaborate, learn and network in order to advance innovations that support the world’s largest shared technologies.

Visit our website and follow us on Twitter, Linkedin, and Facebook for all the latest event updates and announcements.

The Linux Foundation has registered trademarks and uses trademarks. For a list of trademarks of The Linux Foundation, please see its trademark usage page: www.linuxfoundation.org/trademark-usage. Linux is a registered trademark of Linus Torvalds. 

###

Media Contact
Kristin O’Connell
The Linux Foundation
koconnell@linuxfoundation.org

The post The Linux Foundation Announces Agenda and Speaker Lineup for the 2021 Linux Foundation Member Summit appeared first on Linux Foundation.

Vulkan Video Decoding Still In The Early Stages For Open-Source

Phoronix - Tue, 09/21/2021 - 18:33
Going public back in April was the provisional specification around the Vulkan Video extensions as a new industry-standard video encode/decode interface. While several months have passed, there hasn't been much activity yet in the open-source space around Vulkan Video...

Mesa 21.3 Lands Initial Radeon Ray-Tracing Support In Open-Source RADV Vulkan Driver

Phoronix - Tue, 09/21/2021 - 17:25
Landing overnight into Mesa 21.3 was experimentally enabling the Vulkan ray-tracing extensions within the open-source Radeon "RADV" driver...

Pages