Retentive Network: The Successor to Transformer for Large Language Models
Faster alternative to Transformer
A Cookbook of Self-Supervised Learning
Tricks on making SSL work properly. Image focused.
Distributed SVD with memory offloading
How to offload SVD and run it in distributed fashion
Partial Parallelization of Graph Partitioning Algorithm METIS
METIS algorithm is used for fast graph partitioning and is helpful for GNN training
A Survey on Heterogeneous Graph Embedding: Methods, Techniques, Applications and Sources
Good survey
Query Mining
- Mining Query Subtopics from Search Log Data
- On the Weakenesses of Correlation Measures used for Search Engines’ Results
- Heterogeneous Graph-Based Intent Learning with Queries, Web Pages and Wikipedia Concepts
- Distant Supervision for E-commerce Query Segmentation via Attention Network
- Generalized Distances Between Rankings
Tools
- pymoo: Multi-objective Optimization in Python
- ligpg_query: C library for accessing the PostgreSQL parser outside of the server. Returns the SQL parse tree.