## What's Changed * 【开源实习】Speech2Text模型迁移 by @imeet000 in https://github.com/mindspore-lab/mindnlp/pull/1725 * 【开源实习】Unispeech模型迁移 by @liuyifan123123 in https://github.com/mindspore-lab/mindnlp/pull/1722 * Fix typing mistakes in documentation by @Yashbhatt786 in https://github.com/mindspore-lab/mindnlp/pull/1740 * support O2 on OrangePi, tinyllama 450ms -> 160ms by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1744 * fix no_grad state error by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1754 * avoid lack of cumsum operator on OrangePi by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1755 * fix enable_grad by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1757 * fix name for nn.Linear by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1758 * fix nll_loss casued backward error by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1759 * fix out_channels of Linear by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1760 * add toc in readme.md by @adarsh-jha-dev in https://github.com/mindspore-lab/mindnlp/pull/1746 * safe_load_file use mmap to speedup by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1763 * fix from_numpy caused error by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1765 * fix llama embedding by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1774 * upgrade wav2vec by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1776 * update nn.utils.parametrizations by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1777 * fix sew and sew_d by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1782 * fix whisper ut by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1786 * fix llava on Ascend by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1788 * fix mixtral ut by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1790 * fix gamma on CPU and GPU by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1791 * 【开源之夏】add dpo trainer and support dpo training for mindnlp by @Trace2333 in https://github.com/mindspore-lab/mindnlp/pull/1701 * 【开源实习】GPT-J-6B模型应用开发 by @LuMH1027 in https://github.com/mindspore-lab/mindnlp/pull/1742 * 【开源实习】ImageGPT模型应用开发 by @Helloyouth2022 in https://github.com/mindspore-lab/mindnlp/pull/1700 * 【开源实习】X_CLIP模型应用开发 by @dyedd in https://github.com/mindspore-lab/mindnlp/pull/1694 * 【开源实习】UPerNet模型应用开发 by @Maysixi in https://github.com/mindspore-lab/mindnlp/pull/1717 * update whisper stream by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1796 * 【开源实习】multilayer_perceptron_lora模型微调 by @barryyfli in https://github.com/mindspore-lab/mindnlp/pull/1749 * dino应用开发 by @LuMH1027 in https://github.com/mindspore-lab/mindnlp/pull/1797 * support depth_estimation & doc_qa by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1800 * support fill_mask/image_classification/image_feature_extraction pipelines by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1801 * init mimm & move tests folder by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1804 * fix `per_gpu` args by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1809 * add mindspore infer function patch by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1810 * fix sync parallel and support low_cpu_mem_usage by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1814 * 【开源实习】dpt模型应用开发 by @yegoling in https://github.com/mindspore-lab/mindnlp/pull/1813 * 【开源实习】LayoutLMv2模型应用开发 by @Helloyouth2022 in https://github.com/mindspore-lab/mindnlp/pull/1805 * 【开源实习】BERT模型应用开发 by @KhunLounZai in https://github.com/mindspore-lab/mindnlp/pull/1781 * 【开源实习】peft_adalora_seq2seq模型微调 by @liuyifan123123 in https://github.com/mindspore-lab/mindnlp/pull/1747 * 【开源实习】Vision Transformer模型应用开发 by @KhunLounZai in https://github.com/mindspore-lab/mindnlp/pull/1643 * 【开源实习】SegFormer模型应用开发 by @KhunLounZai in https://github.com/mindspore-lab/mindnlp/pull/1663 * 【开源实习】BEiT模型应用开发 by @somecatw in https://github.com/mindspore-lab/mindnlp/pull/1680 * 【开源实习】SAM模型应用开发 by @KhunLounZai in https://github.com/mindspore-lab/mindnlp/pull/1688 * Update prompt_direct.txt by @YadlaMani in https://github.com/mindspore-lab/mindnlp/pull/1732 * fix:解决minicpm未注册问题 by @ResDream in https://github.com/mindspore-lab/mindnlp/pull/1821 * Module support H2D move by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1831 * fix low_cpu_mem_usage(contguous) by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1832 * value_and_grad support attacach grads, Parameter support accumulate a… by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1833 * fix update_and_allocate by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1834 * value_and_grad support kwargs by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1835 * 修复blip推理报错 by @confused666 in https://github.com/mindspore-lab/mindnlp/pull/1838 * fix roll on CPU by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1840 * deprecated mindnlp.transformers.optimization by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1841 * fix optimizer args as same dtype on GPU by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1842 * image_classification_timm_peft_lora模型微调 by @chenxinxi in https://github.com/mindspore-lab/mindnlp/pull/1830 * 【开源实习】 MobileViTV2 模型迁移 by @oucfm in https://github.com/mindspore-lab/mindnlp/pull/1850 * 重做deepseek_v2模型并补注册 by @ShangJingLi in https://github.com/mindspore-lab/mindnlp/pull/1859 * fix: Fix problem using ops.ones in BigBird by @reeered in https://github.com/mindspore-lab/mindnlp/pull/1861 * #benchmark: add GLUE-QNLI benchmark, including 10 models inference accuracy comparsion by @xuhangscut in https://github.com/mindspore-lab/mindnlp/pull/1865 * #fix benchmark GLUE-QNLI fix read_csv error and predict funciton and modify readme description by @xuhangscut in https://github.com/mindspore-lab/mindnlp/pull/1868 * feat: add data parallel of native mindspore to mindnlp.Trainer.base by @Tridu33 in https://github.com/mindspore-lab/mindnlp/pull/1852 * Revert "image_classification_timm_peft_lora模型微调" by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1871 * add minicpm3 model and dynmaic inference demo by @xing-yiren in https://github.com/mindspore-lab/mindnlp/pull/1870 * fix baichuan finfo error by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1872 * fix sbert precision problem on mindnlp.sentence by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1873 * fix cell_ to module_ in mindnlp.peft by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1874 * fix cells to modules in mindnlp.peft by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1875 * fix named_modules by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1877 * fix sbert normalize_embeddings by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1879 * 【开源实习】MindSpore自定义RWKV算子开发（Python接口实现） by @EliwiiKeeya in https://github.com/mindspore-lab/mindnlp/pull/1862 * fix llama and baichuan typo by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1883 * update core.ops with pyboost by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1884 * fix pytest error by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1885 * fix mobilebert register by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1890 * feat: add file lock for remote files download to local path when multiple thread environment. by @Tridu33 in https://github.com/mindspore-lab/mindnlp/pull/1887 * fix ia3 by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1891 * expose prob as positional argument for bernoulli ops by @qhzhuang in https://github.com/mindspore-lab/mindnlp/pull/1949 * fix model llama for split function in line 852 by @zhuizhuzheming in https://github.com/mindspore-lab/mindnlp/pull/1941 * fix TensorPy for mindspore 2.5 by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1961 * fix TensorPy init empty Tensor by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1962 * fix Blip2加载和推理bug #1902 #1904 #1905 by @Alemax067 in https://github.com/mindspore-lab/mindnlp/pull/1958 * 【开源实习】Mask2Former模型应用开发 by @linrx-ctrl in https://github.com/mindspore-lab/mindnlp/pull/1770 * 【开源实习】TAPAS模型应用开发 by @sjtu-weimang in https://github.com/mindspore-lab/mindnlp/pull/1839 * 【开源实习】MaskFormer模型应用开发 by @linrx-ctrl in https://github.com/mindspore-lab/mindnlp/pull/1864 * 【开源实习】YOLOS模型应用开发 by @chenxinxi in https://github.com/mindspore-lab/mindnlp/pull/1867 * 【开源实习】bert_japanese模型微调 by @zhuyuhua1 in https://github.com/mindspore-lab/mindnlp/pull/1892 * 【开源实习】bloom模型微调 by @guyueyuan in https://github.com/mindspore-lab/mindnlp/pull/1907 * 【开源实习】bert_generation模型微调 by @guyueyuan in https://github.com/mindspore-lab/mindnlp/pull/1911 * 【开源实习】bertweet模型微调 by @Alemax067 in https://github.com/mindspore-lab/mindnlp/pull/1964 * 【开源实习】blip_2模型微调 by @Alemax067 in https://github.com/mindspore-lab/mindnlp/pull/1965 * ViTMAE模型应用开发 by @1hb6s7t in https://github.com/mindspore-lab/mindnlp/pull/1956 * fix mindspore2.5-2.6 caused error by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1985 * load safetensor back to numpy by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1986 * support triton self-defined op by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1990 * 开源实习 BEiT 模型微调 by @4everImmortality in https://github.com/mindspore-lab/mindnlp/pull/1975 * 【开源实习】blenderbot模型微调 by @ZhFuGui in https://github.com/mindspore-lab/mindnlp/pull/1978 * 【开源实习】blenderbot_small模型微调 by @outbreak-sen in https://github.com/mindspore-lab/mindnlp/pull/1980 * fix bugs for ms2.5 by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1991 * Fix incorrect import quick_start.md by @XueyanZhang in https://github.com/mindspore-lab/mindnlp/pull/1987 * use new safetensors loader by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1992 * fix ops.max by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1993 * 【开源实习】Bigbird pegasus模型微调 by @outbreak-sen in https://github.com/mindspore-lab/mindnlp/pull/1994 ## New Contributors * @imeet000 made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1725 * @Yashbhatt786 made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1740 * @adarsh-jha-dev made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1746 * @Trace2333 made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1701 * @Helloyouth2022 made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1700 * @dyedd made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1694 * @yegoling made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1813 * @KhunLounZai made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1781 * @somecatw made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1680 * @YadlaMani made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1732 * @confused666 made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1838 * @chenxinxi made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1830 * @oucfm made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1850 * @reeered made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1861 * @xuhangscut made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1865 * @Tridu33 made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1852 * @EliwiiKeeya made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1862 * @zhuizhuzheming made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1941 * @Alemax067 made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1958 * @sjtu-weimang made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1839 * @zhuyuhua1 made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1892 * @guyueyuan made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1907 * @ZhFuGui made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1978 * @XueyanZhang made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1987 **Full Changelog**: https://github.com/mindspore-lab/mindnlp/compare/v0.4.0...v0.4.1