Âé¶¹´«Ã½AV

JSAIT Cover Art December 2021
2021
Beyond Errors and Erasures: Coding for Data Management and Delivery in Networks
Guest editors
Elza Erkip
Deniz Gündüz
Stratis Ioannidis
Joerg Kliewer
Derya Malak
Muriel Médard
R. Srikant

The CFP for JSAIT's 7th Special Issue. The focus of this special issue is on the applications of coding to the broad area of networking for efficient exploitation and delivery of data. Various coding techniques have been devised to tackle erasures and achieve fundamental limits of compression to recover a message with a fidelity criterion. Motivated by the research in this direction and a wide variety of applications at the intersection of distributed systems and networking, this special issue will focus on key aspects ranging from employment of coding for enhancing the efficiency of networking, protocols, computation and delivery in distributed systems, to maintaining consistency in updates and improving accessibility in distributed storage systems, as well as providing desired performance tradeoffs in terms of efficiency, delay and atomicity.

Elza Erkip    Deniz Gündüz    Stratis Ioannidis    Joerg Kliewer    Derya Malak    Muriel Médard    R. Srikant

It is our pleasure to share with you this special issue, providing a snapshot of the current evolution of coding for data management and delivery in networks. Using coding to provide flexibility and efficiency in data management, rather than merely as tool to combat locally bit rot or transmission impediments, has become an increasingly rich and active domain of investigation. It weaves themes of protocol design, resource allocation, quality of experience management and code construction. These aspects arise in the papers of this issue, each of which individually represents one facet of the current state of the art, and collectively we hope constitute a well-cut gem.

Manuj Mukherjee    Ran Gelles

We consider computations over networks with multiple broadcast channels that intersect at a single party. Each broadcast link suffers from random bit-flip noise that affects the receivers independently. We design interactive coding schemes that successfully perform any computation over these noisy networks and strive to reduce their communication overhead with respect to the original (noiseless) computation. A simple variant of a coding scheme by Rajagopalan and Schulman (STOC 1994) shows that any (noiseless) protocol of $R$ rounds can be reliably simulated in $O(R\log n)$ rounds over a network with $n=n_{1}n_{2}+1$ parties in which a single party is connected to $n_{2}$ noisy broadcast channels, each of which connects $n_{1}$ distinct parties. We design new coding schemes with improved overheads. Our approach divides the network into four regimes according to the relationship between $n_{1}$ and $n_{2}$ . We employ a two-layer coding where the inner code protects each broadcast channel and is tailored to the specific conditions of the regime in consideration. The outer layer protects the computation in the network and is generally based on the scheme of Rajagopalan and Schulman, adapted to the case of broadcast channels. The overhead we obtain ranges from $O(\log \log n_{2})$ to $O\left({\log n_{2} \frac {\log \log n_{1}}{\log n_{1}}}\right)$ and beats the trivial $O(\log n)$ overhead in all four regimes.

Nitish Mital    Katina Kralevska    Cong Ling    Deniz Gündüz

We consider a distributed storage system with $n$ nodes, where a user can recover the stored file from any $k$ nodes, and study the problem of repairing $r$ partially failed nodes. We consider broadcast repair, that is, $d$ surviving nodes transmit broadcast messages on an error-free wireless channel to the $r$ nodes being repaired, which are then used, together with the surviving data in the local memories of the failed nodes, to recover the lost content. First, we derive the trade-off between the storage capacity and the repair bandwidth for partial repair of multiple failed nodes, based on the cut-set bound for information flow graphs. It is shown that utilizing the broadcast nature of the wireless medium and the surviving contents at the partially failed nodes reduces the repair bandwidth per node significantly. Then, we list a set of invariant conditions that are sufficient for a functional repair code to be feasible. We further propose a scheme for functional repair of multiple failed nodes that satisfies the invariant conditions with high probability, and its extension to the repair of partial failures. The performance of the proposed scheme meets the cut-set bound on all the points on the trade-off curve for all admissible parameters when $k$ is divisible by $r$ , while employing linear subpacketization, which is an important practical consideration in the design of distributed storage codes. Unlike random linear codes, which are conventionally used for functional repair of failed nodes, the proposed repair scheme has lower overhead, lower input-output cost, and lower computational complexity during repair.

Sijie Li    Rawad Bitar    Sidharth Jaggi    Yihan Zhang

We consider the problem of reliable communication over a network containing a hidden myopic adversary who can eavesdrop on some $z_{ro}$ links, jam some $z_{wo}$ links, and do both on some $z_{rw}$ links. We provide the first information-theoretically tight characterization of the optimal rate of communication possible under all possible settings of the tuple $(z_{ro},z_{wo},z_{rw})$ by providing a novel coding scheme/analysis for a subset of parameter regimes. In particular, our vanishing-error schemes bypass the Network Singleton Bound (which requires a zero-error recovery criteria) in a certain parameter regime where the capacity had been heretofore open. As a direct corollary we also obtain the capacity of the corresponding problem where information-theoretic secrecy against eavesdropping is required in addition to reliable communication.

Yanyan Dong    Sheng Jin    Yanzuo Chen    Shenghao Yang    Hoover H. F. Yin

BATS (BATched Sparse) codes are a class of efficient random linear network coding variation that has been studied for multihop wireless networks mostly in scenarios of a single communication flow. Towards sophisticated multi-flow network communications, we formulate a network utility maximization (NUM) problem that jointly optimizes the BATS code parameters of all the flows and network scheduling. The NUM problem adopts a batch-wise packet loss model that can be obtained from the network local statistics without any constraints on packet loss patterns. Moreover, the NUM problem allows a different number of recoded packets to be transmitted for different batches in a flow, which is called adaptive recoding. Due to both the probably nonconcave objective and the BATS code-related variables, the algorithms developed for the existing flow optimization problems cannot be applied directly to solve our NUM problem. We introduce a two-step algorithm to solve our NUM problem, where the first step solves the problem with nonadaptive recoding schemes, and the second step optimizes adaptive recoding hop-by-hop from upstream to downstream in each flow. We perform various numerical evaluations and simulations to verify the effectiveness and efficiency of the algorithm.

Hoover H. F. Yin    Ka Hei Ng    Allen Z. Zhong    Raymond W. Yeung    Shenghao Yang    Ian Y. Y. Chan

Batched network coding (BNC) is a low-complexity solution to network transmission in multi-hop packet networks with packet loss. BNC encodes the source data into batches of packets. As a network coding scheme, the intermediate nodes perform recoding on the received packets belonging to the same batch instead of just forwarding them. A recoding scheme that may generate more recoded packets for batches of a higher rank is also called adaptive recoding. Meanwhile, in order to combat burst packet loss, the transmission of a block of batches can be interleaved. Stream interleaving studied in literature achieves the maximum separation among any two consecutive packets of a batch, but permutes packets across blocks and hence cannot bound the buffer size and the latency. To resolve the issue of stream interleaver, we design an intrablock interleaver for adaptive recoding that can preserve the advantages of using a block interleaver when the number of recoded packets is the same for all batches. We use potential energy in classical mechanics to measure the performance of an interleaver, and propose an algorithm to optimize the interleaver with this performance measure. Our problem formulation and algorithm for intrablock interleaving are also of independent interest.

Hoover H. F. Yin    Bin Tang    Ka Hei Ng    Shenghao Yang    Xishi Wang    Qiaoqiao Zhou

Batched network coding is a variation of random linear network coding which has low computational and storage costs. In order to adapt to random fluctuations in the number