One of the governmental research organizations is Research and Technology Organization (RTO), whose primary is to harness science and technology in the service of innovation or public bodies and industry, to improve the quality of life and build economic competitiveness. Despite the importance and role of research and technology organizations in the innovation system, previous studies have not addressed the concept of technology development projects' effectiveness implemented in RTOs. This study attempts to investigate this concept from two aspects: "the concept of effectiveness in research projects" and "the concept of effectiveness in RTOs" to define this concept in a research and technology organization (RIPI). To evaluate and implement the proposed framework, eight technology development projects are studied at the Research Institute of Petroleum Industry. Based on the developed indicators and their weights, the effectiveness of eight technology development projects has been evaluated using ARAS, COPRAS, MOORA, and TOPSIS multi-criteria decision-making methods.