目前,大量的视频监控系统被广泛地应用于人们的生产和生活中,然而受限于存储空间和传输带宽,监控图像通常以较低的分辨率进行存储,同时由于单个摄像头覆盖范围比较广,摄像头和嫌疑目标距离通常比较远,人脸和车牌等作为较小的目标,在监控图像中分辨率有限,为其实际应用带来一定的障碍。图像超分辨率重构方法是在不更改现有硬件设施的基础上,通过信号处理的方法,从单张或多张同场景下的低分辨率图像中重构高分辨率图像,是解决上述问题的有效方法。本文围绕监控图像超分辨率重构方法的应用需求,从离线、在线和噪声图像超分辨率重构方面展开了一系列基于稀疏理论的超分辨率重构方法研究,为解决监控图像超分辨率重构问题提供了新的方法和思路。论文的主要研究工作如下: 首先,针对现有图像先验设计形式单一,所含信息量较少的问题,提出了基于梯度稀疏表示的离线超分辨率重构方法。该方法充分利用了稀疏理论在特征重建方面的优势,运用KD树方法为每一个低分辨率特征搜索相似样本,并直接利用这些样本作为稀疏字典通过稀疏表示方式估算高分辨率梯度特征,然后将其作为先验约束条件嵌入到优化求解过程重构高分辨率图像块。该先验既不需要进行样本训练,满足了对放大倍数鲁棒性高的应用需求,又可以提取暗含在外部样本特征集中的隐含先验,弥补了传统先验信息不足的缺点,有效地利用了低分辨率图像本身的特定结构,使其更具针对性。进一步,针对稀疏系数和高分辨率图像求解问题,将高分辨率图像块看作一个优化变量,而不是单单通过稀疏系数和字典相乘重构高分辨率图像块,并通过迭代收缩算法求解稀疏系数和重构高分辨率图像块。在迭代过程中,可以在重构的高分辨率图像块质量逐渐提高的过程中及时更新系数,降低系数误差的影响。实验结果表明,同当前先进的同类方法相比,提出的方法具有更佳的重构效果。 其次,针对当前研究中假设高低分辨率特征空间共享稀疏系数,忽略高低分辨率稀疏系数间真实关系,重构效果依赖于较大的过完备字典而导致在求解稀疏系数问题上计算量较大,无法满足在线应用的问题,提出了基于稀疏系数多线性映射的在线超分辨率重构方法。针对高低分辨率特征空间稀疏系数之间关系的问题,提出了自适应正则化L₂-Boosting算法,构建高低分辨率特征稀疏系数之间的映射函数。算法通过若干次迭代来估算真实系数与其估算值之间的残差,在每次估算中采用2范数约束的回归模型进行残差拟合,并可以自适应确定正则化参数。进一步,针对稀疏分解计算量问题,将高维图像特征进行PCA降维,并采用样本聚类方案,通过K均值聚类将训练样本分成若干类,在类内实现字典训练和映射函数构建,既减小了稀疏字典尺寸,有效降低了稀疏分解的计算量,又解决了很难用一个映射函数覆盖所有结构复杂而丰富的自然图像的问题。实验结果表明,同当前先进的同类方法相比,虽然提出的方法重构效果有所下降,但重构速度仅为其四分之一。 最后,针对目前多数超分辨率重构方法中忽略图像噪声,噪声图像超分辨率重构相关研究成果较少,而传统的去噪和超分辨率串联处理方式容易产生信息丢失和残留噪声放大的问题,分析讨论带噪低分辨率图像块和高分辨率图像块之间的关系,提出了基于双特征稀疏字典的噪声图像超分辨率重构方法,可以同时完成图像去噪和超分辨率重构。首先利用未受噪声干扰的高低分辨率样本对训练稀疏字典,然后通过相似原子加权平均的方式重构相应的图像块。针对相似原子中个别出现相似性不高的问题,提出了基于距离惩罚的优化模型求解权值,可以根据相似度不同而区别对待各原子,增强了模型对噪声的抵抗能力。在字典训练过程中,高低分辨率像素特征被级联到一个特征空间,使高分辨率字典具有双特征特性,联合应用IBP算法达到抑制噪声,增强噪声鲁棒性的目的。实验结果表明,提出的方法在实现过程中不需要根据噪声强度不同而重新训练字典,同传统的串联处理方式相比,在不同噪声强度下均可以有效地提高噪声图像的重构效果。 关键词:超分辨率;稀疏表示;字典学习;先验约束;噪声图像
At present, a large number of video surveillance systems are widely used in people's production and life. Subject to storage space and transmission bandwidth, surveillance images are typically stored at a lower resolution. Also because the coverage of a single camera is relatively wide and the distance between the camera and the suspect target is usually far, the face and license plate are regarded as smaller targets the resolution of which is limited in the surveillance image. That brings certain obstacles to its practical application. Super resolution(SR) which employs signal processing techniques to obtain a high-resolution(HR) image from aliased lowresolution(LR) images or from a single LR image without any hardware facilities replaced is an effective way to solve the above problems. Focusing on the application requirements of surveillance images, this thesis proposes a series of SR methods based on sparse theory including offline, online and noise images SR and provides several new methods and ideas for solving surveillance image SR. The main research work completed by the dissertation is as follows: Firstly, an offline SR method based on gradient sparse representation is proposed to solve the problem that the existing prior has a monotonous form with a small amount of information. This method makes full use of the advantages of sparse theory in feature reconstruction. KD tree is used to search for similar samples for each LR feature, which are used directly as sparse dictionary pair for estimating HR gradient by sparse coding. Then it is used as a prior constraint for optimization to reconstruct HR images. The proposed prior which does not require samples training satisfies the application requirements for high robustness of the magnification and contains implicit priors from examples for making up for the shortcoming of information deficiency of traditional prior, and also effectively uses the specific structure of the LR image itself. Further, for the problem of sovling sparse coefficients and HR patches, each HR patch is considered as optimization variable rather than reconstructing HR patch by the product of sparse coefficients and a dictionary. The sparse coefficients and the HR patch are solved by iterative contraction algorithm and in the process of iterative, the coefficients can be updated in time to improve the quality of the reconstructed image, and the influence of coefficient error can be reduced. Experimental results show that the proposed method can achieve better reconstruction than the current advanced similar methods. Secondly, since it is assumed that high and low resolution feature spaces common share sparse coefficients in the current studies, ignoring the true relationship between HR-LR sparse coefficients and the reason that reconstruction effect relies on a large overcomplete dictionary results in a large amount of computation on solving the sparse coefficient problem, which cannot meet the requirement of online application, an online SR method based on sparse coefficients multiple linear mappings is proposed. For the first problem, an adaptive regularized L₂-Boosting algorithm is proposed to bridge the relationship of sparse coefficients. Several iterations is used to reduce the residual between true coefficients and their estimations. In each iteration, regression model based on 2-norm with adaptive regularized parameter is used for estimation. Further, for the second problem, PCA is used to reduce dimensionality of high-dimensional image features, and the training examples are divided into several groups by K-means clustering. A dictionary pair and a mapping function are learned in each group. It can reduce dictionary size for reducing computation of sparse coding and solve the problem that it is also difficult to use only a single mapping function for covering all complex structures of natural images. Eexperimental results show that compared with the current advanced similar method, although the proposed method has a little reduced reconstruction quality, the running time is only one quarter of it. Finally, to address the problem that most of SR algorithms assume that input LR image is noise-free, and there are few researches related to noise image SR, while the simple casscaded strategy denoise-and SR is easy to cause problems of information loss and residual noise amplification, the relationship between LR patches with noise and HR patches is analyzed and a noisy image SR algorithm based on sparse dictionary with dual feature is proposed, which can present for simultaneously image super resolution. The sparse dictionary is firstly trained by HR-LR samples that are not interfered by noise, and then the corresponding image patch is reconstructed by the weight average of similar atoms. For the problem that there is low similarity in some individual similar atoms, an optimization model based on distance penalty is proposed, which can treat each atom differently according to the similarity to enhance the robustness to noise. In dictionary training process, the HR and LR pixel features are cascaded into one space, so that the HR dictionary obtained has dual feature characteristics, which is combined with IBP algorithm to achieve noise suppression for enhancing noise robustness. Experimental results demonstrate that as the noise intersity varies, the dictionary pair has no need to be replaced or retrained and our algorithms perform better noise robustness than conventional casscaded strategy at different noise levels. Keywords: Super resolution, Sparse represent, Dictionary learning, Prior constraint, Noisy images