Storage Perl automation interview has many of the … [Read more...]
Introduction To Ansible Ansible is a tool for automation. As with any tool it is good at solving some problems. The definition of the problem domain for Ansible includes automation of cloud provisioning(AWS, GCP etc), infrastructure and intra-service orchestration, configuration management and deployments. One can manage and automate containers, VMs with Ansible. Well, one can […]
The challenges of Object storage with Ceph is that it needs to deal with huge files and directories, coordinate the activity of thousands of disks, provide parallel access to metadata on a massive scale, handle both scientific and general-purpose workloads, authenticate and encrypt at large scale, and
grow or shrink dynamically because of frequent device decommissioning, device failures, and cluster expansions.
High level thoughts on Multiprocessing & Multi Client Design considerations Storage systems and subsystem serve their storage as resource for connecting clients to consume. Large scale storage architecture is mostly 2 tier client server (Direct access = faster access). Three tier distributed system architecture consists of a server, middleware and multiple clients. As storage can […]
PCIe interfaces are 2x faster than SATA based interfaces. As the prices of SSD/Flash devices are doing down and Big Data workloads need more of in memory computation. NVMe as a protocol has glaring advantages over AHCI (Advanced Host Controller Interface). Refer to this Article for NVMe introduction : http://avikatestlabs.com/avika-test-labs/a-brief-introduction-to-nvme/ Hmmm, We were using AHCI for SSD, […]
Benchmarking Storage systems(Block, File, object) is complex because of large number of interaction between I/O devices, caches, kernel daemons, monitors, OS, Application software layers, networking. The complexity of performance benchmarking exponentially increases for large scale SAN, NAS Cloud, HPC & MPP(Massively Parallel processing) solutions. Big Data, Machine Learning & AI applications are pushing for real […]