Wav-KAN: Wavelet Kolmogorov-Arnold Networks

Zavareh Bozorgasl; Hao Chen

doi:10.2139/ssrn.4835325

journal article Jan 01, 2024

Wav-KAN: Wavelet Kolmogorov-Arnold Networks

Zavareh Bozorgasl Hao Chen

SSRN Electronic Journal · Elsevier BV

View at Publisher Save 10.2139/ssrn.4835325

Topics

No keywords indexed for this article. Browse by subject →

References

24

[1]

the authors did not mention and didn't apply batch normalization

[2]

We add more simulations including some discrete wavelet ones for MRA

[3]

Z Liu Kan: Kolmogorov-arnold networks (2024)

[4]

D Hendrycks An overview of catastrophic ai risks (2023)

[5]

R Ngo The alignment problem from a deep learning perspective (2022)

[6]

A Survey on Neural Network Interpretability

Yu Zhang, Peter Tino, Aleš Leonardis et al.

IEEE Transactions on Emerging Topics in Computatio... 2021 10.1109/tetci.2021.3100641

[7]

F Doshi-Velez Towards a rigorous science of interpretable machine learning (2017)

[8]

Approximation theory of the MLP model in neural networks

Allan Pinkus

Acta Numerica 1999 10.1017/s0962492900002919

[9]

A Vaswani "Attention is all you need" Advances in neural information processing systems (2017)

[10]

H Cunningham Sparse autoencoders find highly interpretable features in language models (2023)

[11]

F.-L Fan "On interpretability of artificial neural networks: A survey" IEEE Transactions on Radiation and Plasma Medical Sciences (2021) 10.1109/trpms.2021.3066428

[12]

C Olah "Zoom in: An introduction to circuits" Distill (2020) 10.23915/distill.00024.001

[13]

N Elhage Privileged bases in the transformer residual stream, 2023 (2023)

[14]

A N Kolmogorov On the representation of continuous functions of several variables by superpositions of continuous functions of a smaller number of variables (1961)

[15]

D Fakhoury "Exsplinet: An interpretable and expressive spline-based neural network" Neural Networks (2022) 10.1016/j.neunet.2022.04.029

[16]

S Mallat A wavelet tour of signal processing (1999)

[17]

V Saragadam "Wire: Wavelet implicit neural representations" Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2023)

[18]

G James An introduction to statistical learning: With applications in python (2023) 10.1007/978-3-031-38747-0

[19]

A Calder�n "Intermediate spaces and interpolation, the complex method" Studia Mathematica (1964) 10.4064/sm-24-2-113-190

[20]

Decomposition of Hardy Functions into Square Integrable Wavelets of Constant Shape

A. Grossmann, J. Morlet

SIAM Journal on Mathematical Analysis 1984 10.1137/0515056

[21]

A P Witkin "Scale-space filtering" Readings in computer vision (1987)

[22]

S Ioffe "Batch normalization: Accelerating deep network training by reducing internal covariate shift" International conference on machine learning (2015)

[23]

D P Kingma Adam: A method for stochastic optimization (2014)

[24]

I Loshchilov Decoupled weight decay regularization (2017)

Cited By

137

FiberKAN: Kolmogorov–Arnold Networks for Nonlinear Fiber Optics

Xiaotian Jiang, Min Zhang · 2025

Journal of Lightwave Technology

Metrics

137

Citations