Bar-Ilan Faculty of Engineering

Enhancing resilience in distributed networks in the face of malicious agents is an important problem for which many key theoretical results and applications require further development and characterization. This work focuses on the problem of distributed optimization in multi-agent cyberphysical systems, where a legitimate agent's dynamic is influenced both by the values it receives from potentially malicious neighboring agents, and by its own self-serving target function. We develop a new algorithmic and analytical framework to achieve resilience for the class of problems where stochastic values of trust between agents exist and can be exploited. In this case we show that convergence to the true global optimal point can be recovered, both in mean and almost surely, even in the presence of malicious agents. Furthermore, we provide expected convergence rate guarantees in the form of upper bounds on the expected squared distance to the optimal value. Finally, we present numerical results that validate the analytical convergence guarantees we present in this paper even when the malicious agents compose the majority of agents in the network.

Temporal alignment of sequences is a fundamental challenge in many applications, such as computer vision and bioinformatics, where local time shifting needs to be accounted for. Misalignment can lead to poor model generalization, especially in high-dimensional sequences. Existing methods often struggle with optimization when dealing with high-dimensional sparse data, falling into poor alignments. Feature selection is frequently used to enhance model performance for sparse data. However, a fixed set of selected features would not generally work for dynamically changing sequences and would need to be modified based on the state of the sequence. Therefore, modifying the selected feature based on contextual input would result in better alignment. Our suggested method, Conditional Deep Canonical Temporal Time Warping (CDCTW), is designed for temporal alignment in sparse temporal data to address these challenges. CDCTW enhances alignment accuracy for high dimensional time-dependent views be performing dynamic time warping on data embedded in maximally correlated subspace which handles sparsity with novel feature selection method. We validate the effectiveness of CDCTW through extensive experiments on various datasets, demonstrating superior performance over previous techniques.

In recent years, it has become popular to tackle image restoration tasks with a single pretrained diffusion model (DM) and data-fidelity guidance, instead of training a dedicated deep neural network per task. However, such "zero-shot" restoration schemes currently require many Neural Function Evaluations (NFEs) for performing well, which may be attributed to the many NFEs needed in the original generative functionality of the DMs. Recently, faster variants of DMs have been explored for image generation. These include Consistency Models (CMs), which can generate samples via a couple of NFEs. However, existing works that use guided CMs for restoration still require tens of NFEs or fine-tuning of the model per task that leads to performance drop if the assumptions during the fine-tuning are not accurate. In this paper, we propose a zero-shot restoration scheme that uses CMs and operates well with as little as 4 NFEs. It is based on a wise combination of several ingredients: better initialization, back-projection guidance, and above all a novel noise injection mechanism. We demonstrate the advantages of our approach for image super-resolution, deblurring and inpainting. Interestingly, we show that the usefulness of our noise injection technique goes beyond CMs: it can also mitigate the performance degradation of existing guided DM methods when reducing their NFE count.

Recovery of missing phase information from the intensity correlation is crucial in various applications ranging from astronomy to biology. Interferometry and phase retrieval algorithms are common methods for phase recovery. Here, we present a non-interferometric and iteration-free approach for recovering the phase of the Fourier spectrum. This is implemented in an in-line configuration with a structured illumination and a single-pixel estimation of the intensity correlations. Instead of many temporal measurements, single exposure speckle is used to acquire the complex Fourier spectrum from the intensity correlation. Mapping of the complex Fourier spectrum is demonstrated by discretely varying the frequency of the structured illumination and then extracting the intensity correlations for a set of three phase-shifted structured illuminations at each frequency. Furthermore, the recovered Fourier spectrum is used to …

Multi-view representation learning (MvRL) has garnered substantial attention in recent years, driven by the increasing demand for applications that can effectively process and analyze data from multiple sources. In this context, graph Laplacian-based MvRL methods have demonstrated remarkable success in representing multi-view data. However, these methods often struggle with generalization to new data and face challenges with scalability. Moreover, in many practical scenarios, multi-view data is contaminated by noise or outliers. In such cases, modern deep-learning-based MvRL approaches that rely on alignment or contrastive objectives present degraded performance in downstream tasks, as they may impose incorrect consistency between clear and corrupted data sources. We introduce , a novel fusion-based framework that integrates the strengths of graph Laplacian methods with the power of deep learning to overcome these challenges. SpecRage uses neural networks to learn parametric mapping that approximates a joint diagonalization of graph Laplacians. This solution bypasses the need for alignment while enabling generalizable and scalable learning of informative and meaningful representations. Moreover, it incorporates a meta-learning fusion module that dynamically adapts to data quality, ensuring robustness against outliers and noisy views. Our extensive experiments demonstrate that SpecRaGE outperforms state-of-the-art methods, particularly in scenarios with data contamination, paving the way for more reliable and efficient multi-view learning.

Intercalation is a robust method for tuning the physical properties of a vast number of van der Waals (vdW) materials. However, the prospects of using intercalation to modify magnetism in vdWs systems and the associated mechanisms have not been investigated adequately. In this work, we modulate magnetic order in an XY antiferromagnet NiPS3 single crystals by introducing pyridine molecules into the vdWs gap under different thermal conditions. X-ray diffraction measurements indicated pronounced changes in the lattice parameter beta, while magnetization measurements at in-plane and out-of-plane configurations exposed reversal trends in the crystals Neel temperatures through intercalation-de-intercalation processes. The changes in magnetic ordering were also supported by three-dimensional thermal diffusivity experiments. The preferred orientation of the pyridine dipoles within vdW gaps was deciphered via polarized Raman spectroscopy. The results highlight the relation between the preferential alignment of the intercalants, thermal transport, and crystallographic disorder along with the modulation of anisotropy in the magnetic order. The theoretical concept of double-exchange interaction in NiPS3 was employed to explain the intercalation-induced magnetic ordering. The study uncovers the merit of intercalation as a foundation for spin switches and spin transistors in advanced quantum devices.

Training and fine-tuning large language models (LLMs) come with challenges related to memory and computational requirements due to the increasing size of the model weights and the optimizer states. Various techniques have been developed to tackle these challenges, such as low-rank adaptation (LoRA), which involves introducing a parallel trainable low-rank matrix to the fixed pre-trained weights at each layer. However, these methods often fall short compared to the full-rank weight training approach, as they restrict the parameter search to a low-rank subspace. This limitation can disrupt training dynamics and require a full-rank warm start to mitigate the impact. In this paper, we introduce a new method inspired by a phenomenon we formally prove: as training progresses, the rank of the estimated layer gradients gradually decreases, and asymptotically approaches rank one. Leveraging this, our approach involves adaptively reducing the rank of the gradients during Adam optimization steps, using an efficient online-updating low-rank projections rule. We further present a randomized SVD scheme for efficiently finding the projection matrix. Our technique enables full-parameter fine-tuning with adaptive low-rank gradient updates, significantly reducing overall memory requirements during training compared to state-of-the-art methods while improving model performance in both pretraining and fine-tuning. Finally, we provide a convergence analysis of our method and demonstrate its merits for training and fine-tuning language and biological foundation models.

This study addresses the problem of calibrating network confidence while adapting a model that was originally trained on a source domain to a target domain using unlabeled samples from the target domain. The absence of labels from the target domain makes it impossible to directly calibrate the adapted network on the target domain. To tackle this challenge, we introduce a calibration procedure that relies on estimating the network's accuracy on the target domain. The network accuracy is first computed on the labeled source data and then is modified to represent the actual accuracy of the model on the target domain. The proposed algorithm calibrates the prediction confidence directly in the target domain by minimizing the disparity between the estimated accuracy and the computed confidence. The experimental results show that our method significantly outperforms existing methods, which rely on importance weighting, across several standard datasets.

Temporal optics rises from the equivalence between light diffraction in free space and pulse dispersion in dispersive media, paving the way for the development of temporal devices and applications, such as time-lenses. A Four-wave mixing based time-lens allows single-shot measurements of ultra-short signals in high temporal resolution by imaging signals, and inducing temporal Fourier transform. We introduce a cascade time-lens by utilizing a cascade FWM process within the time-lens. We theoretically develop and experimentally demonstrate the cascade time-lens, and confirm that different cascade orders correspond to different effective temporal systems, leading to measuring in various temporal imaging configurations simultaneously with a single optical setup. This approach can simplify experiments and provide a more comprehensive view of a signal’s phase and temporal structure. Such capabilities are …

Accurate and reliable identification of the RTF between microphones with respect to a desired source is an essential component in the design of microphone array beamformers, specifically the MVDR criterion. Since an accurate estimation of the RTF in a noisy and reverberant environment is a cumbersome task, we aim at leveraging prior knowledge of the acoustic enclosure to robustify the RTF estimation by learning the RTF manifold. In this paper, we present a novel robust RTF identification method, tested and trained with real recordings, which relies on learning the RTF manifold using a GCN to infer a robust representation of the RTF in a confined area, and consequently enhance the beamformer's performance.

Most emotion recognition systems fail in real-life situations (in the wild scenarios) where the audio is contaminated by reverberation. Our study explores new methods to alleviate the performance degradation of Speech Emotion Recognition (SER) algorithms and develop a more robust system for adverse conditions. We propose processing multi-microphone signals to address these challenges and improve emotion classification accuracy. We adopt a state-of-the-art transformer model, the Hierarchical Token-semantic Audio Transformer (HTS-AT), to handle multi-channel audio inputs. We evaluate two strategies: averaging mel-spectrograms across channels and summing patch-embedded representations. Our multimicrophone model achieves superior performance compared to single-channel baselines when tested on real-world reverberant environments.

Significance Functional magnetic resonance imaging provides high spatial resolution but is limited by cost, infrastructure, and the constraints of an enclosed scanner. Portable methods such as functional near-infrared spectroscopy and electroencephalography improve accessibility but require physical contact with the scalp. Our speckle pattern imaging technique offers a remote, contactless, and low-cost alternative for monitoring cortical activity, enabling neuroimaging in environments where contact-based methods are impractical or MRI access is unfeasible. Aim We aim to develop a remote photonic technique for detecting human brain cortex activity by applying deep learning to the speckle pattern videos captured from specific brain cortex areas illuminated by a laser beam. Approach We enhance laser speckle pattern tracking with artificial intelligence (AI) to enable remote brain monitoring. In this study, a laser …

We consider the problem of characterizing degree sequences that can be realized by a bipartite graph. If a partition of the sequence into the two sides of the bipartite graph is given as part of the input, then there is a complete characterization that was established more than 60 years ago. However, the general question, in which a partition and a realizing graph need to be determined, is still open. We investigate the role of an important class of special partitions, called High-Low partitions, which separate the degrees of a sequence into two groups, the high degrees and the low degrees. We show that when the High-Low partition exists and satisfies some natural properties, analyzing the High-Low partition resolves the bigraphic realization problem. For sequences that are known to be not realizable by a bipartite graph or that are undecided, we provide approximate realizations based on the High-Low partition.

Humans develop immunoglobulin G (IgG) antibodies to the foods they consume. In the context of food allergy, allergen-specific IgG antibodies can sequentially class-switch to pathogenic IgE. However, the mechanism underlying the antigenicity of food proteins remains uncharacterized. Here, we identified convergent antibodies arising from different antibody gene rearrangements that bind to the immunodominant peanut allergen Ara h 2 and characterized allelic and junctional constraints on germline antibody specificity. Structurally, we found similar epitope-paratope interactions across multiple gene rearrangements. We demonstrate that these germline-encoded epitope-specific convergent antibodies to peanut occur commonly in the population because of the worldwide prevalence of the relevant gene rearrangements, allelic independence, and junctional malleability. As a result, serum IgG to this public epitope …

Recently, a vast amount of literature has focused on the "Neural Collapse" (NC) phenomenon, which emerges when training neural network (NN) classifiers beyond the zero training error point. The core component of NC is the decrease in the within class variability of the network's deepest features, dubbed as NC1. The theoretical works that study NC are typically based on simplified unconstrained features models (UFMs) that mask any effect of the data on the extent of collapse. In this paper, we provide a kernel-based analysis that does not suffer from this limitation. First, given a kernel function, we establish expressions for the traces of the within- and between-class covariance matrices of the samples' features (and consequently an NC1 metric). Then, we turn to focus on kernels associated with shallow NNs. First, we consider the NN Gaussian Process kernel (NNGP), associated with the network at initialization, and the complement Neural Tangent Kernel (NTK), associated with its training in the "lazy regime". Interestingly, we show that the NTK does not represent more collapsed features than the NNGP for prototypical data models. As NC emerges from training, we then consider an alternative to NTK: the recently proposed adaptive kernel, which generalizes NNGP to model the feature mapping learned from the training data. Contrasting our NC1 analysis for these two kernels enables gaining insights into the effect of data distribution on the extent of collapse, which are empirically aligned with the behavior observed with practical training of NNs.

We study the question of whether a sequence of positive integers is the degree sequence of some outerplanar (a.k.a. 1-page book embeddable) graph G. If so, G is an outerplanar realization of d and d is an outerplanaric sequence. The case where is easy, as d has a realization by a forest (which is trivially an outerplanar graph). In this paper, we consider the family of all sequences d of even sum , where is the number of x’s in d. (The second inequality is a necessary condition for a sequence d with to be outerplanaric.) We partition into two disjoint subfamilies, , such that every sequence in is provably non-outerplanaric, and every sequence in is given a realizing graph G enjoying a 2-page book embedding (and moreover, one of the pages is also bipartite).

Background/Objectives: To evaluate the concentrations of trace elements in tear fluid among athletes using particle-induced X-ray emission (PIXE), and to assess the associations with gender, sports intensity, and nutritional supplement intake. Methods: In this cohort study, 84 athletes engaged in high- or low-intensity sports completed a demographic and supplement-use questionnaire. Tear samples were collected using Schirmer strips and analyzed for elemental composition with PIXE, a high-sensitivity technique suited for small biological samples. Multivariate and nonparametric statistical analyses were used to compare groups. Results: There were 46 males and 38 females, aged 17–63 years (mean 30.21 years). Tear phosphorus, potassium, and sulfur concentrations were higher in women than men and higher in women participating in low-intensity compared to high-intensity sports. Tear concentrations of magnesium were higher in men participating in high-intensity sports compared to low-intensity sports. They were higher in men than women regardless of supplement intake. Iron concentrations were higher in men than women only when neither group was taking supplements. Smoking had a slight inverse relationship to iron values. Iron levels were particularly high in men participating in intense sports and low in smokers. Magnesium supplements were associated with raised magnesium levels in tears. Conclusions: This study demonstrates an association between trace element levels in human tears and gender, sports intensity, and food supplement intake. PIXE enables the evaluation of trace element concentration in tears, which may …

Wireless communication-based multi-robot systems open the door to cyberattacks that can disrupt safety and performance of collaborative robots. The physical channel supporting inter-robot communication offers an attractive opportunity to decouple the detection of malicious robots from task-relevant data exchange between legitimate robots. Yet, trustworthiness indications coming from physical channels are uncertain and must be handled with this in mind. In this paper, we propose a resilient protocol for multi-robot operation wherein a parameter {\lambda}t accounts for how confident a robot is about the legitimacy of nearby robots that the physical channel indicates. Analytical results prove that our protocol achieves resilient coordination with arbitrarily many malicious robots under mild assumptions. Tuning {\lambda}t allows a designer to trade between near-optimal inter-robot coordination and quick task execution; see Fig. 1. This is a fundamental performance tradeoff and must be carefully evaluated based on the task at hand. The effectiveness of our approach is numerically verified with experiments involving platoons of autonomous cars where some vehicles are maliciously spoofed.

Significance Integrating multiple biosensors improves the sensitivity and precision of physiological measurements in healthcare monitoring. By combining sensors that target different physiological parameters, a more comprehensive assessment of a subject’s health can be achieved. Aim We evaluate the performance of two biosensors for extracting cardiac parameters: a textile-based strain sensor for measuring respiratory rate and an optical sensor for measuring heart rate, , and respiratory rate. The objective is to determine optimal placement conditions for each sensor and assess their feasibility for integration into a single wearable system. Approach Two experimental setups were tested. In the first, the strain sensor was placed on the subject’s shirt, while the optical sensor was positioned on the external wrist. In the second, both sensors were placed on the chest, under the shirt. The accuracy and performance …

This study investigate the remote detection and reconstruction of audio signals using Radio Frequency (RF) emissions, focusing on the implications for eavesdropping detection and prevention. Utilizing the widely used 2.4 GHz continuous wave microwave radiation directed at a speaker membrane, we successfully reassembled human speech and music signals, demonstrating the feasibility of audio reconstruction in real-world scenarios. A series of denoising techniques, including Robust locally weighted scatterplot smoothing (LOWESS), Moving Median, and Wavelet Denoising, were evaluated for their effectiveness in enhancing signal quality, with performance metrics such as root mean square error (RMSE) and signal-to-noise ratio SNR employed for comparison. Our findings reveal that Wavelet denoising outperforms other methods in preserving the integrity of speech signals, while also highlighting the …