The human genome sequence can be viewed as a ”genome language” that encodes biological information. Our group develop the core technologies of genomic foundation models to gain deep insights into the complex regulatory syntax in DNA sequences and their functional roles. We focus on context-type aware genome foundation models that could provide insights into context-specific gene regulation.