OpenParable
Skip to content
← Back to skills

Verify Multilang Support

Testing & Quality
verify-multilang-support

Verify Multilang Support is an Agent Skill for testing & quality published in the johnhuang316/code-index-mcp repository on GitHub: a SKILL.md instruction file an AI agent can load to do this task.

Use when verifying code-index-mcp multi-language indexing and search behavior against the sample projects under test/sample-projects.

View on GitHub ↗
QUICK START

How to use this skill

Bring this guide into your coding agent with a prompt tailored to the tool you use.

  1. Open your project in Codex.
  2. Copy and paste the prompt below.
  3. Review files and risks before approving any action.
Prompt to paste
Inspect the Agent Skill at https://github.com/johnhuang316/code-index-mcp/blob/HEAD/.agent/skills/verify-multilang-support/SKILL.md and all supporting files. Report provenance, permissions, scripts, dependencies, and security risks. Propose an exact installation into .agents/skills/verify-multilang-support, but wait for my approval before writing files or running scripts.

Copying this prompt does not install or run the skill. Review third-party files before use.

Verify Multi-Language Support

Overview

As an agent, your goal is to verify that the code-index-mcp server can correctly index, deep-index, and search code across different programming languages. Use the MCP tools available in your environment to interact with the sample projects located in test/sample-projects.

Important: This is not a "does it return something" test. You must compare the actual get_file_summary output against the expected baselines below and flag any discrepancy in language, symbol_count, function/method/class names, called_by relationships, and imports.

Instructions

  1. Preparation

    • Locate test/sample-projects.
    • Iterate through the language-specific sample projects listed below.
  2. Verification Loop For each language, perform these steps sequentially:

    a. Set Path

    • Call set_project_path with the absolute path to the sample project.

    b. Shallow Index

    • Call refresh_index to build the shallow (file-list) index.

    c. Deep Index

    • Call build_deep_index to run full symbol extraction.

    d. Search & Verify

    • Run the listed Verification Query using search_code_advanced.
    • Treat the query as a literal search unless the table explicitly says otherwise.

    e. Deep Summary Check — compare against baseline

    • Call get_file_summary for the Preferred File.
    • Compare the result against the Expected Baseline for that language (see section below).
    • Check ALL of the following:
      1. language field matches expected value.
      2. symbol_count is >= the expected minimum.
      3. Every name listed in expected_functions appears in the functions list.
      4. Every name listed in expected_methods appears in the methods list.
      5. Every name listed in expected_classes appears in the classes list.
      6. For each entry in expected_called_by, verify the named symbol's called_by list contains the expected callers.
      7. Every entry in expected_imports appears in the imports list.
    • Mark PASS only if ALL checks pass. If any single check fails, mark FAIL and record which check failed.

    f. Symbol Body Check

    • Call get_symbol_body for the Expected Symbol in the Preferred File.
    • Pass when status is "success" and code is non-empty.

    g. Record Status

    • Track per language:
      • SEARCH: PASS/FAIL
      • SUMMARY: PASS/FAIL (with details on which checks failed)
      • SYMBOL_BODY: PASS/FAIL
      • FINAL: PASS/FAIL
  3. Behavior Smoke Checks

    • After the language loop, run at least one literal-mode smoke check with a regex-like string such as get.*Data and confirm it remains literal when regex mode is omitted or disabled.
    • If native regex support is available, run one explicit regex smoke check and confirm it behaves as regex.
    • Report these separately from the language table.
  4. Reporting

    • Summarize each language with its phase-level statuses in a table.
    • For any FAIL, list the specific check that failed and the actual vs expected values.

Verification Targets

LanguageRelative PathVerification QueryExpected SymbolPreferred File
Pythonpythonclass UserManagerclicli.py
Gogo/user-managementUserServiceCreateUserinternal/services/user_service.go
Javajava/user-managementclass UserManagerUserManager.createUsersrc/main/java/com/example/usermanagement/services/UserManager.java
JavaScriptjavascript/user-managementclass UserServiceUserService.createUsersrc/services/UserService.js
TypeScripttypescript/user-managementclass UserServiceusersrc/services/UserService.ts
C#csharp/ordersclass OrderServiceOrders.Services.OrderService.Createsrc/Orders/Services/OrderService.cs
Kotlinkotlin/notes-apiclass NotesServiceNotesService.createNotesrc/main/kotlin/com/example/notes/NotesService.kt
Rustrust/conversationstruct ConversationConversation.appendsrc/conversation.rs
Objective-Cobjective-cinterface UserManagerUserManager.addUserUserManager.m
Zigzig/code-index-examplefn mainmainsrc/main.zig

Expected Baselines

Python — cli.py

language: python
symbol_count_min: 11
expected_functions:
  - cli
  - create_user
  - get_user
  - list_users
  - update_user
  - delete_user
  - authenticate
  - stats
  - export
  - search
  - main
expected_methods: []
expected_classes: []
expected_called_by:
  cli: ["cli.py::main"]
  create_user: ["cli.py::create_user"]
expected_imports:
  - click
  - json
  - typing.Optional
  - services.user_manager.UserManager
  - services.auth_service.AuthService

Go — internal/services/user_service.go

language: go
symbol_count_min: 21
expected_functions:
  - UserService
  - NewUserService
expected_methods:
  - CreateUser
  - GetUserByID
  - GetUserByUsername
  - GetUserByEmail
  - UpdateUser
  - DeleteUser
  - HardDeleteUser
  - GetAllUsers
  - GetActiveUsers
  - GetUsersByRole
  - SearchUsers
  - GetUserStats
  - AuthenticateUser
  - ChangePassword
  - ResetPassword
  - AddPermission
  - RemovePermission
  - ExportUsers
  - GetUserActivity
expected_classes: []
expected_called_by:
  NewUserService: ["internal/services/user_service.go::CreateUser"]  # at least this caller
  GetUserByID:
    - "internal/services/user_service.go::UpdateUser"
    - "internal/services/user_service.go::DeleteUser"
    - "internal/services/user_service.go::ChangePassword"
  GetUserByUsername: ["internal/services/user_service.go::AuthenticateUser"]
  GetAllUsers: ["internal/services/user_service.go::ExportUsers"]
expected_imports:
  - encoding/json
  - errors
  - gorm.io/gorm

Java — src/main/java/com/example/usermanagement/services/UserManager.java

language: java
symbol_count_min: 25
expected_functions: []
expected_methods:
  - UserManager.createUser
  - UserManager.getUser
  - UserManager.updateUser
  - UserManager.deleteUser
  - UserManager.getAllUsers
  - UserManager.getActiveUsers
  - UserManager.getUsersByRole
  - UserManager.filterUsers
  - UserManager.searchUsers
  - UserManager.getUserStats
  - UserManager.exportUsers
  - UserManager.exportToJson
  - UserManager.exportToCsv
expected_classes:
  - UserManager
expected_called_by:
  UserManager.getUser:
    - "src/main/java/com/example/usermanagement/services/UserManager.java::UserManager.updateUser"
    - "src/main/java/com/example/usermanagement/services/UserManager.java::UserManager.deleteUser"
  UserManager.filterUsers:
    - "src/main/java/com/example/usermanagement/services/UserManager.java::UserManager.getUsersOlderThan"
    - "src/main/java/com/example/usermanagement/services/UserManager.java::UserManager.getUsersWithEmail"
    - "src/main/java/com/example/usermanagement/services/UserManager.java::UserManager.getUsersWithPermission"
  UserManager.getActiveUsers:
    - "src/main/java/com/example/usermanagement/services/UserManager.java::UserManager.getUserStats"
expected_imports:
  - com.example.usermanagement.models.User
  - com.example.usermanagement.models.UserRole
  - java.util.*

JavaScript — src/services/UserService.js

language: javascript
symbol_count_min: 20
expected_functions: []
expected_methods:
  - UserService.createUser
  - UserService.getUserById
  - UserService.updateUser
  - UserService.deleteUser
  - UserService.hardDeleteUser
  - UserService.getAllUsers
  - UserService.searchUsers
  - UserService.authenticateUser
  - UserService.exportUsers
  - UserService.getUserActivity
expected_classes:
  - UserService
expected_called_by:
  UserService.createUser: ["src/routes/userRoutes.js:106"]
  UserService.getUserById: ["src/routes/userRoutes.js:189"]
  UserService.updateUser: ["src/routes/userRoutes.js:205"]
  UserService.deleteUser: ["src/routes/userRoutes.js:254"]
  UserService.getAllUsers: ["src/routes/userRoutes.js:139"]
expected_imports: []  # JS file has no extracted imports

TypeScript — src/services/UserService.ts

language: typescript
symbol_count_min: 5
expected_functions:
  - user
  - validationErrors
  - total
  - totalPages
  - token
expected_methods: []
expected_classes: []
expected_called_by:
  user:
    - "src/routes/userRoutes.ts:127"
    - "src/routes/userRoutes.ts:276"
expected_imports_contain:
  - "import { User } from '../models/User'"
  - "import { AppError } from '../utils/errors'"

C# — src/Orders/Services/OrderService.cs

language: csharp
symbol_count_min: 4
expected_functions:
  - Orders.Services.OrderService.#ctor
expected_methods:
  - Orders.Services.OrderService.Create
  - Orders.Services.OrderService.MarkPaid
expected_classes:
  - Orders.Services.OrderService
expected_called_by:
  Orders.Services.OrderService.#ctor: ["src/Orders/Program.cs::Orders.Program.Main"]
  Orders.Services.OrderService.Create: ["src/Orders/Program.cs::Orders.Program.Main"]
  Orders.Services.OrderService.MarkPaid: ["src/Orders/Program.cs::Orders.Program.Main"]
expected_imports:
  - Orders.Models
  - Orders.Repositories

Kotlin — src/main/kotlin/com/example/notes/NotesService.kt

language: kotlin
symbol_count_min: 4
expected_functions: []
expected_methods:
  - NotesService.createNote
  - NotesService.find
  - NotesService.publish
expected_classes:
  - NotesService
expected_called_by:
  NotesService.createNote: ["src/main/kotlin/com/example/notes/NotesApp.kt::NotesApp.run"]
  NotesService.find:
    - "src/main/kotlin/com/example/notes/NotesService.kt::NotesService.publish"
  NotesService.publish: ["src/main/kotlin/com/example/notes/NotesApp.kt::NotesApp.run"]

Rust — src/conversation.rs

language: rust
symbol_count_min: 7
expected_functions:
  - helper
  - run
expected_methods:
  - Conversation.new
  - Conversation.append
expected_classes:
  - Conversation
  - Status
  - Runnable
expected_called_by:
  helper:
    - "src/conversation.rs::run"
    - "src/conversation.rs::Conversation.append"
expected_imports:
  - std::collections::VecDeque

Objective-C — UserManager.m

language: objective-c
symbol_count_min: 5
expected_functions: []
expected_methods:
  - UserManager.sharedManager
  - UserManager.addUser
  - UserManager.findUserByName
  - UserManager.removeUser
  - UserManager.userCount
expected_classes: []
expected_called_by: {}  # Objective-C currently has no cross-method called_by tracking
expected_imports:
  - UserManager.h

Zig — src/main.zig

language: zig
symbol_count_min: 2
expected_functions:
  - main
  - testOne
expected_methods: []
expected_classes: []
expected_called_by: {}  # Zig currently has no called_by tracking
expected_imports: []

Tips

  • Confirm the sample project's real relative path before assuming the table is current.
  • Objective-C does not have a subdirectory — its files sit directly under test/sample-projects/objective-c/.
  • Python's sample project also has files at the top level (cli.py, __init__.py).
  • If a baseline check fails, read the actual file to determine whether the baseline is stale (sample project changed) or the indexer has a bug. Update the baseline if the sample project legitimately changed.
  • When new languages are added, add a baseline section here based on the actual get_file_summary output.