Abstract
Embedding static graphs in low-dimensional vector spaces plays a key role in network analytics and inference, supporting applications like node classification, link prediction, and graph visualization. However, many real-world networks present dynamic behavior, including topological evolution, feature evolution, and diffusion. Therefore, several methods for embedding dynamic graphs have been proposed to learn network representations over time, facing novel challenges, such as time-domain modeling, temporal features to be captured, and the temporal granularity to be embedded. In this survey, we overview dynamic graph embedding, discussing its fundamentals and the recent advances developed so far. We introduce the formal definition of dynamic graph embedding, focusing on the problem setting and introducing a novel taxonomy for dynamic graph embedding input and output. We further explore different dynamic behaviors that may be encompassed by embeddings, classifying by topological evolution, feature evolution, and processes on networks. Afterward, we describe existing techniques and propose a taxonomy for dynamic graph embedding techniques based on algorithmic approaches, from matrix and tensor factorization to deep learning, random walks, and temporal point processes. We also elucidate main applications, including dynamic link prediction, anomaly detection, and diffusion prediction, and we further state some promising research directions in the area.
Topics

No keywords indexed for this article. Browse by subject →

References
133
[3]
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. Retrieved from https://arXiv:1409.0473.
[12]
Chuanchang Chen, Yubo Tao, and Hai Lin. 2019. Dynamic network embeddings for network evolution analysis. Retrieved from https://arXiv:1906.09860.
[13]
Jinyin Chen, Xuanheng Xu, Yangyang Wu, and Haibin Zheng. 2018. GC-LSTM: Graph convolution embedded LSTM for Dynamic link prediction. Retrieved from https://arXiv:1812.04206.
[14]
Jinyin Chen, Jian Zhang, Xuanheng Xu, Chenbo Fu, Dan Zhang, Qingpeng Zhang, and Qi Xuan. 2021. E-LSTM-D: A deep learning framework for dynamic network link prediction. IEEE Trans. Syst. Man Cybernet.: Syst. 51, 6 (2021).
[16]
Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN Encoder-decoder for statistical machine translation. Retrieved from https://arXiv:1406.1078.
[17]
Peng Cui, Xiao Wang, Jian Pei, and Wenwu Zhu. 2018. A survey on network embedding. IEEE Trans. Knowl. Data Eng. 31, 5 (2018), 833–852.
[18]
Hanjun Dai, Yichen Wang, Rakshit Trivedi, and Le Song. 2016. Deep coevolutionary network: Embedding user and item features for recommendation. Retrieved from https://arXiv:1609.03675.
[20]
V. Dave and M. Hasan. 2020. Triangle completion time prediction using time-conserving embedding. In Machine Learning and Knowledge Discovery in Databases U. Brefeld E. Fromont A. Hotho A. Knobbe M. Maathuis and C. Robardet (Eds). ECML PKDD 2019. Lecture Notes in Computer Science vol 11906. Springer Cham. https://doi.org/10.1007/978-3-030-46150-8_32 10.1007/978-3-030-46150-8_32
[27]
Carlos Henrique Gomes Ferreira, Fabricio Murai Ferreira, Breno de Sousa Matos, and Jussara Marques de Almeida. 2019. Modeling dynamic ideological behavior in political networks. J. Web Sci. 7 (2019).
[29]
Rishab Goel, Seyed Mehran Kazemi, Marcus Brubaker, and Pascal Poupart. 2019. Diachronic embedding for temporal knowledge graph completion. Retrieved from https://arXiv:1907.03143.
[32]
Palash Goyal, Sujit Rokka Chhetri, Ninareh Mehrabi, Emilio Ferrara, and Arquimedes Canedo. 2018. DynamicGEM: A library for dynamic graph embedding methods. Retrieved from https://arXiv:1811.10734.
[34]
Palash Goyal, Nitin Kamra, Xinran He, and Yan Liu. 2018. DynGEM: Deep embedding method for dynamic graphs. Retrieved from https://arXiv:1805.11273.
[35]
Daniele Grattarola and Cesare Alippi. 2020. Graph neural networks in tensorflow and keras with spektral. Retrieved from https://arXiv:2006.12138.
[38]
William L. Hamilton, Rex Ying, and Jure Leskovec. 2017. Representation learning on graphs: Methods and applications. IEEE Data Eng. Bull. 40, 3 (2017), 52–74.
[39]
Farzaneh Heidari and Manos Papagelis. 2018. EvoNRL: Evolving network representation learning based on random walks. In Proceedings of the International Conference on Complex Networks and their Applications. Springer, 457–469.
[41]
Long Short-Term Memory

Sepp Hochreiter, Jürgen Schmidhuber

Neural Computation 10.1162/neco.1997.9.8.1735
[45]
Seyed Mehran Kazemi, Rishab Goel, Kshitij Jain, Ivan Kobyzev, Akshay Sethi, Peter Forsyth, and Pascal Poupart. 2020. Representation learning for dynamic graphs: A survey. J. Mach. Learn. Res. 21, 70 (2020), 1–73.
[48]
Diederik P. Kingma and Max Welling. 2013. Auto-encoding variational bayes. Retrieved from https://arXiv:1312.6114.
[49]
Thomas N. Kipf and Max Welling. 2016. Semi-supervised classification with graph convolutional networks. Retrieved from https://arXiv:1609.02907.
[50]
Thomas N. Kipf and Max Welling. 2016. Variational graph auto-encoders. Retrieved from https://arXiv:1611.07308.

Showing 50 of 133 references

Cited By
138
Applied Soft Computing
Stiff-PDEs and Physics-Informed Neural Networks

Prakhar Sharma, Llion Evans · 2023

Archives of Computational Methods i...
Metrics
138
Citations
133
References
Details
Published
Nov 23, 2021
Vol/Issue
55(1)
Pages
1-37
License
View
Cite This Article
Claudio D. T. Barros, Matheus R. F. Mendonça, Alex B. Vieira, et al. (2021). A Survey on Embedding Dynamic Graphs. ACM Computing Surveys, 55(1), 1-37. https://doi.org/10.1145/3483595
Related

You May Also Like

Data clustering

A. K. Jain, M. N. Murty · 1999

9,568 citations

Anomaly detection

Varun Chandola, Arindam Banerjee · 2009

8,799 citations

Machine learning in automated text categorization

Fabrizio Sebastiani · 2002

5,027 citations

Object tracking

Alper Yilmaz, Omar Javed · 2006

3,632 citations

A Survey on Bias and Fairness in Machine Learning

Ninareh Mehrabi, Fred Morstatter · 2021

3,466 citations