最近,双曲表示学习,双曲图表示学习由于其指数增长特性,已成为处理具有tree-like结构或幂律分布的图数据的有前途的替代方案。与多项式增长的欧几里得空间不同,双曲空间呈指数增长,这使其在具有层次组织的树状或无标度图方面具有天然优势。在这个库中,作者将与双曲线表示学习相关的论文分类为不同的类型,以促进研究人员的研究并促进社区的发展。主要的内容包括下面的一些方面:
https://github.com/marlin-codes/Awesome-Hyperbolic-Graph-Representation-Learning
Contributed by: Menglin Yang, Min Zhou
Introduction
Recently, hyperbolic spaces have emerged as a promising alternative for processing graph data with tree-like structure or power-law distribution, owing to its exponential growth property. Different from the Euclidean space which expands polynomially, the hyperbolic space grows exponentially which makes it gains natural advantages in abstracting tree-like or scale-free graphs with hierarchical organizations. In this repository, we categorize papers related to hyperbolic representation learning into different types to facilitate researcher studies and to promote the development of the community. We will keep updating this repository with latest research developments. We are aware that there will inevitable be some mistakes and oversights, so if you find any questions and suggestions, please feel free to contact us (mlyang@cse.cuhk.edu.hk).
1. Lastest Update |
2. Surveys, Books, Tools and Tutorials |
2.1 Surveys | 2.2 Books |
2.3 Tools | 2.4 Tutorials |
3. Methods |
3.1 Hyperbolic Shallow Model | 3.2 Hyperbolic Neural Network |
3.3 Hyperbolic Graph Neural Network | 3.4 Mixed Curvature Learning |
3.5 Ultrahyperbolic Learning | 3.6 Hyperbolic Operations |
4. Applications |
4.1 Recommender Systems | 4.2 Knowledge Graphs |
4.3 Molecular Learning |
4.4 Dynamic Graphs |
4.4 Code Representation | 4.5 Graph Embedding |
4.6 Word Embedding | 4.7 Multi-label Learning |
4.8 Computer Vision | 4.9 Natural Language Processing |
Latest update
HICF: Hyperbolic Informative Collaborative Filtering for recommender systems, KDD 2022
HyperAid: Denoising in hyperbolic spaces for tree-fitting and hierarchical clustering for clustering, KDD 2022
Wrapped Distributions on homogeneous Riemannian manifolds for hyperbolic sampling, arxiv 2022
Contrastive Multi-view Hyperbolic Hierarchical Clustering for clustering, IJCAI 2022
Hyperbolic Relevance Matching for Neural Keyphrase Extraction for key phrases matching, Naacl 2022
Cross-lingual Word Embeddings in Hyperbolic Space for word embedding, arxiv 2022
Geometry Interaction Knowledge Graph Embeddings for KG embedding, AAAI 2022
Surveys, Books, Tools, Tutorials
Surveys
Hyperbolic Graph Neural Networks: A Review of Methods and Application, arxiv 2022.GitHub
Menglin Yang, Min Zhou, Zhihao Li, Jiahong Liu, Lujia Pan, Hui Xiong, Irwin King
Hyperbolic Deep Neural Networks: A Survey, TPAMI 2022.GitHub
Wei Peng, Tuomas Varanka, Abdelrahman Mostafa, Henglin Shi, Guoying Zhao
Books
Hyperbolic Geometry, 2020.
Brice Loustau
Manifolds and Differential Geometry, 2009.
Jeffrey M. Lee
Tools
Geoopt: Riemannian Adaptive Optimization Methods ICLR 2019
Max Kochurov and Rasul Karimov and Serge Kozlukov
Curvature Learning Framework
Alibaba
GraphZoo: A Development Toolkit for Graph Neural Networks with Hyperbolic Geometries WWW 2022
Anoushka Vyas, Nurendra Choudhary, Mehrdad Khatir, Chandan K. Reddy
Tutorials
Hyperbolic Graph Representation Learning. Tutorial 2022
Min Zhou, Menglin Yang, Lujia Pan, Irwin King @ ECML-PKDD 2022
Hyperbolic Neural Network. Tutorial 2022
Nurendra Choudhary, Nikhil Rao, Karthik Subbian, Srinivasan Sengamedu, Chandan Reddy @ KDD 2022
Hyperbolic Hyperbolic embeddings in machine learning and deep learning. Tutorial 2020
Octavian Ganea 2020.
Methods
Hyperbolic Shallow Model
-
Learning Continuous Hierarchies in the Lorentz Model of Hyperbolic Geometry, ICML 2018
Maximilian Nickel, Douwe Kiela
Poincaré Embeddings for Learning Hierarchical Representations, NeurIPS 2017
Maximilian Nickel, Douwe Kiela
Hyperbolic Neural Network
Fully Hyperbolic Neural Networks, ACL 2022
Weize Chen, Xu Han, Yankai Lin, Hexu Zhao, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou
Hyperbolic Neural Network++, ICLR 2021
Ryohei Shimizu, Yusuke Mukuta, Tatsuya Harada
Hyperbolic Attention Networks, ICLR 2019
Caglar Gulcehre, Misha Denil, Mateusz Malinowski, Ali Razavi, Razvan Pascanu, Karl Moritz Hermann, Peter Battaglia, Victor Bapst, David Raposo, Adam Santoro, Nando de Freitas
Hyperbolic Neural Networks, NeurIPS 2018
Octavian-Eugen Ganea, Gary Bécigneul, Thomas Hofmann
Hyperbolic Graph Neural Network
Hyperbolic Graph Convolutional Neural Networks, NeurIPS 2019
Ines Chami*, Rex Ying*, Christopher Ré, Jure Leskovec
Hyperbolic Graph Neural Network, NeurIPS 2019
Qi Liu, Maximilian Nickel, Douwe Kiela
Lorentzian Graph Convolutional Networks, WWW 2021
Yiding Zhang, Xiao Wang, Chuan Shi, Nian Liu, Guojie Song
A Hyperbolic-to-Hyperbolic Graph Convolutional Network, CVPR 2021
Jindou Dai, Yuwei Wu, Zhi Gao, Yunde Jia
Hyperbolic Graph Attention Network, Transcations on Big Data 2021
Yiding Zhang, Xiao Wang, Xunqiang Jiang, Chuan Shi, Yanfang Ye
Unsupervised Hyperbolic Representation Learning via Message Passing Auto-Encoders, CVPR 2021
Jiwoong Park, Junho Cho, Hyung Jin Chang, Jin Young Choi
Mixed Curvature Learning
A Self-supervised Mixed-curvature Graph Neural Network, AAAI 2022
Li Sun, Zhongbao Zhang, Junda Ye, Hao Peng, Jiawei Zhang, Sen Su, Philip S. Yu
Enhancing Hyperbolic Graph Embeddings via Contrastive Learning, NeurIPS 2021 SSL Workshop
Jiahong Liu, Menglin Yang, Min Zhou, Shanshan Feng, Philippe Fournier-Viger
Geometry Interaction Learning, NeurIPS 2020
Shichao Zhu, Shirui Pan, Chuan Zhou, Jia Wu, Yanan Cao, Bin Wang
Constant Curvature Graph Convolutional Networks, ICML 2020
Gregor Bachmann, Gary Bécigneul, Octavian-Eugen Ganea
Ultrahyperbolic Learning
Semi-Riemannian Graph Convolutional Networks, NeurIPS 2022
Bo Xiong, Shichao Zhu, Nico Potyka, Shirui Pan, Chuan Zhou, Steffen Staab
Ultrahyperbolic Neural Networks, NeurIPS 2021
Marc T Law
Ultrahyperbolic Representation Learning, NeurIPS 2020
Marc T. Law, Jos Stam
Hyperbolic Operations
Mean Computation and BatchNorm
Differentiating through the Fréchet Mean, ICML 2022
Aaron Lou, Isay Katsman, Qingxuan Jiang, Serge Belongie, Ser-Nam Lim, Christopher De Sa
Normalizing Flow
Latent Variable Modelling with Hyperbolic Normalizing Flows, ICML 2020
Avishek Joey Bose, Ariella Smofsky, Renjie Liao, Prakash Panangaden, William L. Hamilton
Sampling
Wrapped Distributions on homogeneous Riemannian manifolds, 2022
Fernando Galaz-Garcia, Marios Papamichalis, Kathryn Turnbull, Simon Lunagomez, Edoardo Airoldi
MixUp
HYPMIX: Hyperbolic Interpolative Data Augmentation(https://aclanthology.org/2021.emnlp-main.776/), EMNLP 2021
Ramit Sawhney, Megh Thakkar, Shivam Agarwal, Di Jin, Diyi Yang, Lucie Flek
PCA
HoroPCA: Hyperbolic Dimensionality Reduction via Horospherical Projections, ICML 2021
*Ines Chami, Albert Gu, Dat Nguyen, Christopher Ré
Applications
Recommender Systems
Hyperbolic Graph Neural Network for Recommender Systems
HICF: Hyperbolic Informative Collaborative Filtering, KDD 2022
Menglin Yang, Zhihao Li, Min Zhou, Jiahong Liu, Irwin King
HRCF: Enhancing Collaborative Filtering via Hyperbolic Geometric Regularization, WWW 2022
Menglin Yang, Min Zhou, Jiahong Liu, Defu Lian, Irwin King
HAKG: Hierarchy-Aware Knowledge Gated Network for Recommendation, SIGIR 2022
Yuntao Du, Xinjun Zhu, Lu Chen, Baihua Zheng, and Yunjun Gao
Geometric Inductive Matrix Completion: A Hyperbolic Approach with Unified Message Passing, WSDM 2022
Chengkun Zhang , Hongxu Chen , Sixiao Zhang , Guandong Xu , Junbin Gao
Modeling Scale-free Graphs with Hyperbolic Geometry for Knowledge-aware Recommendation, WSDM 2022
Yankai Chen, Menglin Yang, Yingxue Zhang, Mengchen Zhao, Ziqiao Meng, Jianye Hao, Irwin King
HGCF: Hyperbolic Graph Convolution Networks for Collaborative Filtering, WWW 2021
Jianing Sun,Zhaoyue Cheng,Saba Zuberi,Felipe Perez,Maksims Volkovs
Hypersorec: Exploiting hyperbolic user and item representations with multiple aspects for social-aware recommendation, TOIS 2021
Hao Wang, Defu Lian, Hanghang Tong, Qi Liu, Zhenya Huang and Enhong Chen
Knowledge Based Hyperbolic Propagation, SIGIR short paper 2021
Chang-You Tai, Chien-Kun Huang, Liang-Ying Huang, Lun-Wei Ku
HSR: hyperbolic social recommender, Information Sciences 2022
Anchen Li, Bo Yang
HCGR: Hyperbolic Contrastive Graph Representation Learning for Session-based Recommendation, arxiv 2021
Naicheng Guo, Xiaolei Liu, Shaoshuai Li, Qiongxu Ma, Yunan Zhao, Bing Han, Lin Zheng, Kaixin Gao, Xiaobo Guo
Hyperbolic Hypergraphs for Sequential Recommendation, CIKM 2021
Yicong Li, Hongxu Chen, Xiangguo Sun, Zhenchao Sun, Lin Li, Lizhen Cui, Philip S. Yu, Guandong Xu
Hyperbolic Neural Network for Recommender Systems
Where are we in embedding spaces? A Comprehensive Analysis on Network Embedding Approaches for Recommender Systems KDD 2021
Sixiao Zhang, Hongxu Chen, Xiao Ming, Lizhen Cui, Hongzhi Yin, Guandong Xu
Learning Feature Interactions with Lorentzian Factorization Machine, AAAI 2020
Canran Xu, Ming Wu
HyperML: A Boosting Metric Learning Approach in Hyperbolic Space for Recommender Systems, WSDM 2020
Lucas Vinh Tran, Yi Tay, Shuai Zhang, Gao Cong, Xiaoli Li
Scalable Hyperbolic Recommender Systems, WSDM 2020
Benjamin Paul Chamberlain, Stephen R. Hardwick, David R. Wardrope, Fabon Dzogang, Fabio Daolio, Saúl Vargas
A hyperbolic metric embedding approach for next-poi recommendation, SIGIR 2020
Shanshan Feng , Lucas Vinh Tran , Gao Cong , Lisi Chen , Jing Li , Fan Li
Node2LV: Squared Lorentzian Representations for Node Proximity, ICDE 2021
Shanshan Feng, Lisi Chen, Kaiqi Zhao, Wei Wei, Fan Li, Shuo Shang
Knowledge Graphs
Hyperbolic Graph Neural Network for Knowledge Graphs
-
Knowledge Association with Hyperbolic Knowledge Graph Embeddings, EMNLP 2020
Zequn Sun, Muhao Chen, Wei Hu, Chengming Wang, Jian Dai, Wei Zhang
Knowledge Graph Representation via Hierarchical Hyperbolic Neural Graph Embedding, IEEE Big Data
Shen Wang, Xiaokai Wei, Cicero Nogueira Dos Santos, Zhiguo Wang, Ramesh Nallapati, Andrew Arnold, Philip S. Yu
Mixed-Curvature Multi-relational Graph Neural Network for Knowledge Graph Completion, WWW 2021
Shen Wang , Xiaokai Wei , Cicero Nogueira Nogueira dos Santos , Zhiguo Wang , Ramesh Nallapati , Andrew Arnold , Bing Xiang , Philip S. Yu , Isabel F. Cruz
Hyperbolic Translational Models for KG
Low-Dimensional Hyperbolic Knowledge Graph Embeddings, ACL 2019
Ines Chami, Adva Wolf, Da-Cheng Juan, Frederic Sala, Sujith Ravi, Christopher Ré
Multi-relational Poincaré Graph Embeddings, NeurIPS 2019
Ivana Balažević, Carl Allen, Timothy Hospedales
Modeling Heterogeneous Hierarchies with Relation-specific Hyperbolic Cones, NeurIPS 2021
Yushi Bai, Rex Ying, Hongyu Ren, Jure Leskovec
Hyperbolic Temporal Knowledge Graph Embeddings with Relational and Time Curvatures, ACL 2021
Sebastien Montella, Lina Rojas-Barahona, Johannes Heinecke
Self-supervised hyperboloid representations from logical queries over knowledge graphs, WWW 2021
Nurendra Choudhary, Nikhil Rao, Sumeet Katariya, Karthik Subbian, Chandan K. Reddy
HyperKG: Hyperbolic Knowledge Graph Embeddings for Knowledge Base Completion, arxiv
Prodromos Kolyvakis, Alexandros Kalousis, Dimitris Kiritsis
Hyperbolic Hierarchy-Aware Knowledge Graph Embedding for Link Prediction. EMNLP findings 2021
Zhe Pan, Peng Wang
Molecular Learning
Hyperbolic Graph Neural Network for Molecular Learning
Hyperbolic relational graph convolution networks plus: a simple but highly efficient QSAR-modeling method, Briefings in Bioinformatics 2021
Zhenxing Wu, Dejun Jiang, Chang-Yu Hsieh, Guangyong Chen, Ben Liao, Dongsheng Cao, Tingjun Hou
Semi-supervised hierarchical drug embedding inhyperbolic space, J. Chem. Inf. Model 2020
Ke Yu*, Shyam Visweswaran*, and Kayhan Batmanghelich
Hyperbolic Neural Network models for Molecular Learning
- HiG2Vec: hierarchical representations of Gene Ontology and genes in the Poincaré ball, Bioinformatics, 2021
Jaesik Kim, Dokyoon Kim, Kyung-Ah Sohn
Dynamic Graphs
Discrete-time Temporal Network Embedding via Implicit Hierarchical Learning in Hyperbolic Space, KDD 2021
Menglin Yang, Min Zhou, Marcus Kalander, Zengfeng Huang, Irwin King
Hyperbolic Variational Graph Neural Network for Modeling Dynamic Graphs, AAAI 2021
Li Sun, Zhongbao Zhang, Jiawei Zhang, Feiyang Wang, Hao Peng, Sen Su, Philip S. Yu
Exploring the Scale-Free Nature of Stock Markets: Hyperbolic Graph Learning for Algorithmic Trading, WWW 2021
Ramit Sawhney , Shivam Agarwal , Arnav Wadhwa , Rajiv Shah
Code Representation
- Hyperbolic Representations of Source Code AAAI 2022
Raiyan Khan, Thanh V. Nguyen, Sengamedu H. Srinivasan
Graph Embeddings
Hyperbolic Geometry for Heterogeneous Network Embedding
Hyperbolic Heterogeneous Information Network Embedding, AAAI 2020
Xiao Wang, Yiding Zhang, Chuan Shi
Embedding Heterogeneous Information Network in Hyperbolic Spaces, TKDD 2022
Yiding Zhang, Xiao Wang, Nian Liu, Chuan Shi
Hyperbolic Geometry for Directed Graph Embedding
Hyperbolic Disk Embeddings for Directed Acyclic Graphs,ICML 2019
Ryota Suzuki, Ryusuke Takahama, Shun Onoda
A hyperbolic Embedding Model for Directed Networks
Zongning Wu, Zengru Di, Ying Fan (this paper includes many errors)
Hyperbolic Geometry for Signed Graph Embedding
- Hyperbolic Node Embedding for Signed Networks, Neurcomputing 2021
Wenzhuo Song, Hongxu Chen, Xueyan Liu, Hongzhe Jiang, Shengsheng Wang
Hyperbolic Geometry for Attributed Graph Embedding
- HEAT: Hyperbolic Embedding of Attributed Networks, IDEAL 2020
David McDonald, Shan He
Word Embeddings
Poincare Glove: Hyperbolic Word Embeddings, ICLR 2019
Alexandru Tifrea and Gary Becigneul and Octavian-Eugen Gane
Skip-gram word embeddings in hyperbolic space, ACL 2018
Matthias Leimeister, Benjamin J. Wilson
Embedding text in hyperbolic spaces, ACL 2018
Bhuwan Dhingra, Christopher J. Shallue, Mohammad Norouzi, Andrew M. Dai, George E. Dahl
Representation Tradeoffs for Hyperbolic Embeddings, ICML 2018
Christopher De Sa, Albert Gu, Christopher Ré, Frederic Sala
Hyperbolic entailment cones for learning hierarchical embeddings, ICML 2018
Octavian-Eugen Ganea, Gary Bécigneul, Thomas Hofmann
Low-rank approximations of hyperbolic embeddings
Pratik Jawanpuria, Mayank Meghwanshi, Bamdev Mishra
Hyperbolic Multiplex Network Embedding with Maps of Random Walk
Peiyuan Sun
Multi-label Learning
Hyperbolic interaction model for hierarchical multi-label classification, AAAI 2021
Boli Chen, Xin Huang, Lin Xiao, Zixin Cai, Liping Jing
Hyperbolic Capsule Networks for Multi-Label Classification, ACL 2020
Boli Chen, Xin Huang, Lin Xiao, Liping Jing
Joint Learning of Hyperbolic Label Embeddings for Hierarchical Multi-label Classification, EACL 2021
Soumya Chatterjee, Ayush Maheshwari, Ganesh Ramakrishnan, Saketha Nath Jagaralpudi
Hyperbolic Embeddings for Hierarchical Multi-label Classification, 2020
Tomaž StepišnikEmail, Dragi Kocev
A Fully Hyperbolic Neural Model for Hierarchical Multi-Class Classification, EMNLP findings
Federico López, Michael Strube
Computer Vision
Hyperbolic Vision Transformers: Combining Improvements in Metric Learning,cvpr 2022
Aleksandr Ermolov, Leyla Mirvakhabova, Valentin Khrulkov, Nicu Sebe, Ivan Oseledets
Clipped Hyperbolic Classifiers Are Super-Hyperbolic Classifiers, cvpr 2022
Yunhui Guo, Xudong Wang, Yubei Chen, Stella X. Yu
Hyperbolic Image Segmentation, cvpr 2022
Mina GhadimiAtigh, Julian Schoep, Erman Acar, Nanne van Noord, Pascal Mettes
Capturing implicit hierarchical structure in 3D biomedical images with self-supervised hyperbolic representations NeurIPS 2021
Joy Hsu, Jeffrey Gu, Gong-Her Wu, Wah Chiu, Serena Yeung
Learning Hyperbolic Representations of Topological Features ICLR 2021
Panagiotis Kyriakis, Iordanis Fostiropoulos, Paul Bogdan
-
Curvature Generation in Curved Spaces for Few-Shot Learning, ICCV 2021
Zhi* Gao, Yuwei Wu*, Yunde Jia, Mehrtash Harandi
Unsupervised Discovery of the Long-Tail in Instance Segmentation Using Hierarchical Self-Supervision, CVPR 2021
Zhenzhen Weng, Mehmet Giray Ogut, Shai Limonchik, Serena Yeung
Mix Dimension in Poincaré Geometry for 3D Skeleton-based Action Recognition, ACM MM 2020
Wei Peng, Jingang Shi, Zhaoqiang Xia, Guoying Zhao
Hyperbolic Image Embedding, CVPR 2020
Valentin Khrulkov, Leyla Mirvakhabova, Evgeniya Ustinova, Ivan Oseledets, Victor Lempitsky
Meta Hyperbolic Networks for Zero-Shot Learning, Neurocomputing
Yan Xu, Lifu Mu, ZhongJi, Xiyao Liu, JungongHan
Natural Language Processing
Medical Triage Chatbot Diagnosis Improvement via Multi-relational Hyperbolic Graph Neural Network. SIGIR short paper 2021
Zheng Liu , Xiaohan Li , Zeyu You , Tao Yang , Wei Fan , Philip Yu
ANTHEM: Attentive Hyperbolic Entity Model for Product Search. WSDM 2022
Nurendra Choudhary , Nikhil Rao , Sumeet Katariya , Karthik Subbian , Chandan K. Reddy
Hyperbolic Metric Learning
Hyperbolic Busemann Learning with Ideal Prototypes, NeurIPS 2021
Mina Ghadimi Atigh, Martin Keller-Ressel, Pascal Mettes
Unsupervised Hyperbolic Metric Learning, CVPR 2021
Jiexi Yan, Lei Luo, Cheng Deng, Heng Huang