XCTB – X Compression Tool Benchmarker

I deal with a lot of big files at work. While storage capacity is not infinite indeed. So it’s in my interest to keep the file sizes as low as possible.

One way to achieve that is by using compression. Especially when dealing with log files, or database archive, you can save a ton of space with the right compression tool.

But space saving is not the only consideration.

You also need to weighs in other factors. Such as :

  • File type : different tool will compress different type of file differently
  • CPU multi-core capabilities
  • Compression speed
  • Compression size
  • Decompression time

But there are so many great compression tools available in Unix / Linux. It can be really confusing to choose which one to use even for a seasoned expert.

So I created X Compression Tool Benchmarker to help with this.

Features :

  • Test any kind of file : just put the file’s name as the parameter when calling the script. Then it will be tested against all the specified compression tools.
  • Add more compression tool easily : just edit the compressor_list & ext_file variable, and that’s it
  • Fire and forget : just run the script, and forget it. It will run without needing any intervention
  • CSV output : ready to be opened with Libre Office / Excel, and made into graphs in seconds.

Here’s a sample result for a Database archive file (type MySQL dump) :

The bar chart on top of this article is based from this result.

As you can see, currently this script will benchmark the following compression tools automatically : pigz – gzip – bzip2 – pbzip2 – lrzip – rzip – zstd – pixz – plzip – xz

The result, for each different file types, may surprise you 🙂

For example ; I was surprised to see rzip beat lrzip – because lrzip is supposed to be the enhancement of rzip.

Then I was even more surprised to find out that :

  • I was testing Debian Buster’s version of rzip, which turned out to be pretty old – it does not even have multi-thread/core capability
  • But when I tested the latest version of rzip, which can use all the 16 cores in my server – it turned out to be slower than the old rzip from Debian Buster !
  • No, disk speed is not an issue – I made sure that all the benchmark was run from NVME SSD

So I was grinning at how Debian Buster packaged a very old version of rzip instead of the new one – turned out the joke’s on me : the old rzip perform better than the new one. Even without the multi-core capability.

Also it was amazing to see how really REALLY fast zstd is, while still giving decent compression size. When you absolutely need compression speed, this not so well known compression tool turned out to be the clear winner.

And so on, etc

Yes, indeed I had fun 🙂

I hope you will too. Enjoy !


UPDATE : My friend , Eko Juniarto, published his results here and have permitted me to publish it here as well – thanks. Very interesting, indeed.

Franz Kafka — Montblanc

Franz Kafka (3 July 1883 – 3 June 1924) was a Bohemian author, widely regarded as one of the major figures of 20th-century literature. His work fuses elements of realism and the fantastic. It typically features isolated protagonists facing bizarre or surrealistic predicaments and incomprehensible socio-bureaucratic powers. It has been interpreted as exploring themes of alienation, existential anxiety, guilt, and absurdity. His best known works include Die Verwandlung (The Metamorphosis), Der Process (The Trial), and Das Schloss (The Castle).

In 2004, Montblanc has launched a special edition for Franz Kafka. The design of the fountain pen of this series is not only reminiscent of the simple and yet artful style of its eponym, but also pays tribute to Kafka’s The Metamorphosis. In the fascinating change from square to round in the writing instrument’s form, the metamorphosis described in Kafka’s story has found its equivalent.

Top, clip and rings made of 925 sterling silver offer a thrilling contrast to the dark red translucent aura of the barrel. A further reference to The Metamorphosis is on the rhodium-plated 18-karat gold nib: a finely engraved cockroach.

Die ungeheure Welt, die ich im Kopfe habe. Aber wie mich befreien und sie befreien, ohne zu zerreißen. Und tausendmal lieber zerreißen, als in mir sie zurückhalten oder begraben. Dazu bin ich ja hier, das ist mir ganz klar

Franz Kafka 21-06-1913

Franz Kafka — Montblanc

Franz Kafka (3 July 1883 – 3 June 1924) was a Bohemian author, widely regarded as one of the major figures of 20th-century literature. His work fuses elements of realism and the fantastic. It typically features isolated protagonists facing bizarre or surrealistic predicaments and incomprehensible socio-bureaucratic powers. It has been interpreted as exploring themes of alienation, existential anxiety, guilt, and absurdity. His best known works include Die Verwandlung (The Metamorphosis), Der Process (The Trial), and Das Schloss (The Castle).

In 2004, Montblanc has launched a special edition for Franz Kafka. The design of the fountain pen of this series is not only reminiscent of the simple and yet artful style of its eponym, but also pays tribute to Kafka’s The Metamorphosis. In the fascinating change from square to round in the writing instrument’s form, the metamorphosis described in Kafka’s story has found its equivalent.

Top, clip and rings made of 925 sterling silver offer a thrilling contrast to the dark red translucent aura of the barrel. A further reference to The Metamorphosis is on the rhodium-plated 18-karat gold nib: a finely engraved cockroach.

Die ungeheure Welt, die ich im Kopfe habe. Aber wie mich befreien und sie befreien, ohne zu zerreißen. Und tausendmal lieber zerreißen, als in mir sie zurückhalten oder begraben. Dazu bin ich ja hier, das ist mir ganz klar

Franz Kafka 21-06-1913

BCA – daftar bank korespondensi di Amerika

Suatu hari saya ditanyakan hal ini (bank korespondensi BCA di Amerika) setelah selesai seminar di Hawaii, untuk mentransfer honorarium saya.

Ternyata info ini tidak ketemu dimana-mana.

Tanya via Call center BCA di 1500888, mereka juga tidak tahu.

Akhirnya ketika istri saya kebetulan ada perlu ke BCA, dia tanyakan sekalian. Dijawab bahwa musti saya sendiri yang datang menanyakan.

Istri saya marah besar 😀 hahahaha

Apa logikanya cuma menanya “informasi bank korespondensi BCA” dengan saya musti datang sendiri ke BCA 😀 ha ha ha

Kalau karena musti nasabah BCA – istri saya juga nasabah BCA, dia juga punya rekening di BCA.

Akhirnya customer service BCA menyerah, dan memberitahu informasi tsb, hahaha. Ada-ada saja.

Saya lampirkan informasi tsb disini. Maka moga yang membutuhkannya tidak perlu mengalami kekonyolan serupa & terbuang-buang waktunya juga.

NAMA BANK : Bank of New York
ABA ROUTING NUMBER : IRVTUS3N

NAMA BANK : Bank of America
ABA ROUTING NUMBER : BOFAUS6S

NAMA BANK : Wells Fargo Bank
ABA ROUTING NUMBER : PNBPUS3NNYC

NAMA BANK : JP Morgan Chase Bank
ABA ROUTING NUMBER : CHASUS33

NAMA BANK : Citibank
ABA ROUTING NUMBER : CITIUS33

NAMA BANK : Standard Chartered Bank
ABA ROUTING NUMBER : SCBLUS33

Saint-Exupéry 120 Tahun

Andai tidak ada wabah COVID-19, tentu hari ini dirayakan luar biasa oleh para penggemar tulisannya di seluruh dunia. Antoine Marie Jean-Baptiste Roger, Vicomte de Saint-Exupéry, lahir di Lyon 29 Juni 1900. Hari kelahirannya kini disebut sebagai Hari Pangeran Kecil.

Juni tahun lalu aku sempat mengunjungi kembali dinding di Pantheon yang dipahat untuk mengenang Pahlawan Perancis yang menghilang saat misi pengintaian di pantai selatan Perancis 75 tahun sebelumnya (31 Juni 1944). Seorang pioneer di industri penerbangan beberapa dekade sebelumnya, dia memaksakan diri untuk terbang pada usia yang sudah tidak optimal, dan menghilang dalam tugas.

Buku Pangeran Kecil ditulis seolah sebagai memoar dalam keresahan St-Ex, yang bahkan melintasi waktu. Pangeran Kecil resah akibat ancaman kerusakan pada planetnya oleh baobab, akhirnya pergi ke bumi, untuk melihat dunia yang acuh dan bodoh. Dengan bekal seadanya — gambar domba saja — Sang Pangeran Kecil memutuskan kembali. Dia dipatuk ular padang pasir, dan pastinya meninggal, namun sebenarnya ia hanya menghilang. Begitupun St-Ex yang meninggalkan Eropa hanya untuk melihat masyarakat Amerika yang masa bodoh. Ia menyerahkan manuskrip Le Petit Prince ke penerbit, lalu kembali ke Eropa, dan hilang dalam misinya. Pastinya meninggal? Namun ia — seperti yang ditulis di dinding Pantheon — hanya menghilang.

Yang dikhawatiri St-Ex untuk dapat merusak Eropa adalah bibit-bibit totalitarianisme, kediktatoran, yang berawal seolah dari gerakan rakyat yang hendak mengangkat harkat hidupnya. Waktu kecil, tak jelas mana bibit tanaman biasa, dan mana tanaman perusak. Namun kita harus waspada. Pangeran Kecil rajin menyapu planetnya, memastikan tuna baobab tak tumbuh. Ia pun mencari domba untuk makan tunas baobab, sambil khawatir domba makan bunga mawarnya. Sebelum St-Ex pergi ke Amerika pun, ia telah didiskreditkan baik oleh Pemerintah Vichy yang mendukung pendudukan Nazi di Perancis, maupun oleh Jendral Charles de Gaulle sang pemimpin gerakan Perancis Merdeka. Pemerintahan Vichy — suka atau terpaksa — memang pendukung kediktatoran Hitler. Namun St-Ex melihat bahwa de Gaulle pun memiliki sikap dan peluang seorang diktator. Musuh kemanusiaan, dan ancaman bagi rakyat, bukan yang di kanan atau di kiri, melainkan potensi totalitarianisme, baik pada individu maupun kelompok.

Tahun-tahun peringatan 120 tahun lahirnya St-Ex (serta 75 tahun menghilangnya St-Ex tahun lalu) diperingati secara tenang, nyaris tanpa keramaian. Tahun lalu, Montblanc Jakarta mengundangku menyampaikan cerita Si Pangeran Kecil pada para loyal customer-nya. Montblanc menerbitkan edisi khusus St-Ex tahun 2017, dan edisi khusus Pangeran Kecil tahun 2018, 2019, dan 2020. Tentang perpenaan ini, sila simak di SYLO.INK.

Site LEPETITPRINCE.EU juga sudah makin dilengkapi dengan data buku Pangeran Kecil yang makin banyak dari 6 benua (minus Antarktika) dan 3 lautan, termasuk wilayah-wilayah di tengah samudera dan di sekitar kutub utara. Situs berbasis wilayah negara itu kini ditemani juga dengan situs baru PANGERANKECIL.COM yang berbasis akar bahasa. Jumlah buku sudah mencapai … ah apa sih relevansinya angka dengan dunia kita?

Absensi Online Semudah Selfie

Salah satu masalah dalam kehidupan dengan COVID-19 adalah kita harus berada di tempat-tempat kita sendiri. Work from Home (WfH). Bekerja dari rumah. Kuliah dari rumah. Dan seterunya. Bagaimana dengan masalah absensi? (Kata “absensi” ini sebetulnya kurang tepat, lebih tepatnya adalah kehadiran atau presensi, tetapi saya gunakan kata ini karena ini yang lebih umum digunakan.)

Kebayakan dari kita masih menggunakan absensi konvensional, yaitu tanda tangan di atas kertas yang diedarkan di kertas. Atau yang paling “maju” sekalipun adalah menggunakan mesin sidik jari. Sekarang mesin sidik jarinya di kantor / di kampus, sementara kita berada di rumah. Kalaupun kita berada di kampus, sekarang agak ngeri dengan menyentuh alat yang disentuh oleh banyak orang. Hiiii… ngeriii… Maka dibutuhkan solusi terhadap masalah ini.

Jangan khawatir. Sekarang sudah ada teknologi Artificial Intelligence (AI) yang dapat mengenali wajah sehingga kita dapat melakukan absensi dengan mudah. “Absensi semudah selfie” Nah. Bagaimana cara kerjanya? Berikut ini adalah video dari teknologi Face Recognition (FR) yang dikembangkan oleh Riset.AI (PT Riset Kecerdasan Buatan).

Sistem ini sudah digunakan oleh beberapa pihak. Di tempat saya sendiri, sistem ini digunakan untuk absensi setiap hari.

Top Covid-19 resilient tech careers

image source: rainmakers.co

The world is facing its worst health crisis in a century. The Covid-19 pandemic has killed more than 400,000 people, infected millions, and brought the economy to a standstill. Its changes to the economy and society have been nothing short of profound, with an unprecedented number of jobs destroyed across all industries.

In March, the International Labor Organization (ILO) predicted that nearly 25 million jobs could be lost by the end of 2020. Later, the organization acknowledged that the actual number could be significantly higher. The US has seen an unprecedented number of people file for unemployment, and 57 percent of Americans surveyed recently report being worried about losing their jobs.

Millions of laid-off workers around the world are now looking for new opportunities, and many are turning to the tech sector. This industry offers some of the safest career paths today, particularly as thousands of companies worldwide realize the importance of digitalization, remote work, and moving to platforms. 

These are some of the career paths in tech with the best prospects:

Database Administration

Database Administrators create, update, and manage databases and associated programs. They are responsible for ensuring a database is accessible and functions as intended. They play a critical role in many companies, especially those that generate large amounts of data. 

A Database Administrator also needs to ensure a database is secure by protecting confidential information and setting up the right user permissions. They work with other Database Administrators and other professionals to ensure an application can consume and amend information from a database correctly. In many cases, a Database Administrator stores internal information rather than information used for a specific app.

The Bureau of Labour Statistics predicts that demand for these professionals will grow by 9 percent in the next ten years. The median salary for a Database Administrator is $90,070.

One of the best-paid career options for Database Administrators is to become Data Scientists. These professionals are in charge of collecting and analyzing vast amounts of data. Companies used their findings to make decisions critical to their bottom line. The Data Scientist turns massive lists of data into actionable recommendations that help a business achieve its goals. They are one of the most in-demand professionals in the sector.

Marketing is a very lucrative industry for Data Scientists. Insights produced by a Data Scientist can tell a retail store which products to stock or recommend to a customer. In combination with modern Artificial Intelligence techniques like machine learning, Data Scientists can play an important role in creating targeted campaigns that boost sales.

The average salary for a Data Scientist last year was $120,495.

Systems Administration

According to LinkedIn, Systems Operator is the second most in-demand job right now in the US. Network and Systems Administrators manage complex systems that are vital to the functioning of businesses and organizations. These professionals are in-demand today in virtually every industry in the country, with the Bureau of Labour Statistics predicting that the number of job openings for this position will grow by 5 percent from 2018 to 2028 

Every business can potentially employ Network and Systems Administrators. These professionals earn high salaries, even compared to other technology jobs. In 2018, the median salary for this profession was $82,050

A job closely related is DevOps Consultant. DevOps is a combination of two teams, the development team and the operations team. The two groups work together to create products faster and more efficiently. 

To pursue a career as a DevOps Consultant, you must first gain experience as a DevOps Engineer. You need a bachelor’s degree in computer science or computer engineering and years of experience in software development and systems operations. 

Additional qualifications, like the AWS Certified DevOps Engineer Professional, make you a competitive candidate for DevOps jobs. As a DevOps Consultant, your duty is to help companies implement software development principles to optimize applications. You answer to company leadership and liaise for management, software developers, and the IT team, combining their unique views into actionable steps. You need excellent technical skills for this role.

In 2019, the average salary for a DevOps Engineer was $99,604.

In this category, we also have IT Infrastructure Engineers. These professionals ensure that all the IT systems that support businesses of any size function efficiently. With global connections predicted to reach 3.5 billion by 2023, the demand for Remote Engineers can only go up. IT Infrastructure Engineers have the flexibility of being able to work remotely. 

Infrastructure Engineers work with Internet connections, cabling, virtualization platforms, and storage area networks. They ensure all the systems within an organization function seamlessly. A Network Infrastructure Engineer works on-site or remotely evaluating all the systems within an infrastructure.

These professionals interact with all vendors on behalf of their organizations and must possess excellent written and spoken communication skills.

The average salary for this position is $72,323 a year.

Software Development

From phone apps to Internet browsers, Software Engineers are responsible for many of the programs that power the modern economy. Every industry in the world uses the software of some kind, so the demand for this type of engineer isn’t waning anytime soon.

Moreover, consider this: almost 6 in 10 employers would consider changing their work-from-home policies if their workers were able to maintain productivity during the pandemic, according to a March survey from Monster. To enable workers to do their jobs from home, the software architecture that powers remote digital services need to be built and maintained. As demand for the services increase, so will job in this area. 

There are several paths to a career as a software developer if you’re interested in this growing field. Some developers opt for a bachelor’s degree or even a master’s in computer science. But more and more tech companies and other employers are favoring workers with practical experience in developing software applications. This is why you should consider attending a coding boot camp.

The median salary in 2018 for Software Developers was $105,590 a year or $51 an hour. In 2018, there were 1,365,500 people employed in this area, but this is expected to grow by 21 percent by 2028.

UX/UI Design

Someone has to design all of the web pages and applications we use every day. The people who design these products are in high demand and command handsome salaries, which makes a career in UX/UI design very attractive.

A User Experience (UX) Designer focuses on how users experience a product. Their goal is to create a product that is as easy to use and as intuitive as possible. They conduct research that exposes the potential challenges customers may face with a given product. Based on their findings, UX Designers make changes to a design or feature to optimize the user experience.

On the other hand, a User Interface (UI) Designer is responsible for creating a product’s overall design. Their responsibilities may include choosing the colors of a website or making sure that the font is as readable as possible. They also assess the accessibility of design and the overall style of each element. UI Designers use the information gathered by UX Designers to create beautiful and functional designs.

In short, the UX Designer conducts research and identifies problems customers face with a product. They then pass that information to the UI Designer, who uses it to create an attractive and functional design for the product.

Breaking into a Career in Tech

If you are considering starting down a path in the tech sector, you first need to acquire the necessary technical skills and knowledge. To do this, you have several options at your disposal. The traditional route is to study computer science at a university or college to earn an academic degree. Many tech employers indeed favor university graduates.

A second—and increasingly more popular—the path is to attend a coding boot camp. Bootcamps allow you to acquire the skills you need to have your foot at the door in a short time. In less than fifteen weeks of intense, practical training, you will learn the basics of your chosen profession and will be ready to apply for jobs. 

More and more people are choosing coding boot camps over studying full-time at a university. This is because boot camps represent a much smaller time and money investment and are considered the smarter alternative. 

Finally, many tech sector hopefuls choose to teach themselves. Depending on how disciplined and able to motivate yourself you are, this may be the right option for you.

~ Artur Meyster

 

The post Top Covid-19 resilient tech careers appeared first on BudiPutra.com.

Oxford University — Onoto

For my birthday, I will display one of my favourite pen: Oxford Blue Magna Classic by Onoto. This pen is dedicated for the University of Oxford, and it was designed with the official Oxford blue coloured resin and complemented by sterling silver fittings including a broad engraved cap band, the University of Oxford crest on the cap button and Onoto Chevron clip.

The Oxford Magna is based on the style and shape of one of the most famous Onoto fountain pens — the Onoto Magna of 1937 which is still acclaimed as one of the best fountain pen ever made.

Surely I bought it because of its dedication for The University of Oxford. But I do not buy pens just for collecting them. I remember the first day with the pen, I filled it with a GFC Midnight Blue ink, since I thought it perfectly matched the colour of the pen. Then I wrote a few line with it, and instantly fell in love. It surprisingly writes very smoothly, finely, comfortably, and I could write my best with this pen. I never change the colour of the ink for this pen since then. I guess this is the only pen I have, in which I never changed the ink since the beginning.

This Onoto pen accompanied me to many events, including international conferences, congress, classrooms, meetings. Nobody recognised the Onoto brand, though. Onoto is not a famous brand here in Indonesia. I guess people just think this is a souvenir from a visit to Oxford University.

I was in The University of Oxford in 2012 just for a short visit. The small city expressed the elegance of the academic tradition of the University’s colleges throughout the city.

Oxford University — Onoto

For my birthday, I will display one of my favourite pen: Oxford Blue Magna Classic by Onoto. This pen is dedicated for the University of Oxford, and it was designed with the official Oxford blue coloured resin and complemented by sterling silver fittings including a broad engraved cap band, the University of Oxford crest on the cap button and Onoto Chevron clip.

The Oxford Magna is based on the style and shape of one of the most famous Onoto fountain pens — the Onoto Magna of 1937 which is still acclaimed as one of the best fountain pen ever made.

Surely I bought it because of its dedication for The University of Oxford. But I do not buy pens just for collecting them. I remember the first day with the pen, I filled it with a GFC Midnight Blue ink, since I thought it perfectly matched the colour of the pen. Then I wrote a few line with it, and instantly fell in love. It surprisingly writes very smoothly, finely, comfortably, and I could write my best with this pen. I never change the colour of the ink for this pen since then. I guess this is the only pen I have, in which I never changed the ink since the beginning.

This Onoto pen accompanied me to many events, including international conferences, congress, classrooms, meetings. Nobody recognised the Onoto brand, though. Onoto is not a famous brand here in Indonesia. I guess people just think this is a souvenir from a visit to Oxford University.

I was in The University of Oxford in 2012 just for a short visit. The small city expressed the elegance of the academic tradition of the University’s colleges throughout the city.

Belajar Tidak Selalu Berhasil

Seharian ini saya mencoba ngoprek pemrograman lagi. Coding. Sebetulnya saya hanya ingin mencoba menggunakan bahasa pemrograman Golang untuk membaca webcam saya melalui OpenCV. Masalahnya versi OpenCV yang didukung Golang adalah versi terbaru yang tidak ada di komputer saya. Artinya saya harus mengunduh dan merakit (compile) sendiri. Oke lah.

Dahulu saya biasa merakit sendiri berbagai paket program dari kode sumbernya. Tidak masalah. Namun sekarang ternyata proses perakitannya menjadi lebih kompleks. Ini disebabkan kode sumbernya juga semakin kompleks dan platform yang digunakan orang juga bervariasi sehingga ada banyak konfigurasi yang harus dilakukan. Ternyata konfigurasi bawaan dari paket ini tidak cocok dengan sistem operasi yang saya gunakan (Linux Mint 18.1 Serena).

Setelah ngoprek nyaris seharian – dari pagi sampai menjelang Maghrib ini – ternyata hasilnya tidak ada, alias gagal. Ya begitulah. Belajar kadang memang harus seperti ini. Banyak gagalnya dahulu. Tidak selalu harus berhasil. Kesel memang. (Ini ngetiknya juga sambil kesel.) Habis mau gimana lagi? Keselnya saya adalah karena menghabiskan waktu yang seharusnya dapat saya gunakan untuk belajar yang lainnya. Grrr.

Anggap saja ini adalah upaya saya untuk menambah “jam terbang” ngoprek Linux. (Padahal saya ngoprek Linux sejak pertama kali dia dibuat Linus. ha ha ha.)

Berikut layar terakhir hari ini sebelum saya berhenti dulu. “100% tapi gagal”. Heu.

Oh ya, versi videonya ada di YouTube channel saya. Ini dia.