What programming languages are supported?

CodeXGLUE primarily focuses on programming languages like Java, Python, and C#.

CodeXGLUE

CodeXGLUE | Find AI List

Overview

CodeXGLUE is a benchmark dataset designed to evaluate and compare models for code intelligence tasks. It encompasses 14 datasets across 10 diversified code intelligence scenarios, including code-to-code translation, code summarization, and natural language code search. The platform supports the development of models leveraging pre-trained architectures like CodeBERT and CodeGPT. It aids developers in improving productivity through tasks such as code completion, defect detection, and code repair. Microsoft Research Asia, Developer Division, and Bing jointly created CodeXGLUE. The platform provides baseline models and pipelines, enabling researchers to participate in open challenges and contribute to the advancement of code intelligence. It includes tasks covering code-code, text-code, code-text, and text-text scenarios.

Common tasks

Code Completion Code Translation Code Search Defect Detection Code Summarization Code Understanding Code Generation Model Evaluation

FAQ

View all

What is CodeXGLUE?

CodeXGLUE is a benchmark dataset and open challenge for code intelligence, including tasks such as code completion, translation, search, and summarization.

What tasks are included in CodeXGLUE?

CodeXGLUE includes tasks covering code-code (clone detection, defect detection, cloze test, code completion, code repair, and code-to-code translation), text-code (natural language code search, text-to-code generation), code-text (code summarization), and text-text (documentation translation).

What baseline models are provided?

CodeXGLUE provides three baseline models: a BERT-style pre-trained model (CodeBERT), a GPT-style pre-trained model (CodeGPT), and an Encoder-Decoder framework.

How can I participate in the open challenge?

Download the datasets, set up the baseline models, fine-tune the models using the provided pipelines, evaluate your model on the benchmark tasks, and submit your results to the leaderboard.

FAQ+