Preferring IISER Kolkata is not a mistake, but the right choice depends on what you want from the next five years. If your aim is research in fundamental physics, there is a view among students that science-focused institutes are a better environment than engineering-focused IITs, where placements and the engineering degree tend to dominate the culture. Someone aiming for a long research career may reasonably lean towards a core science institute.
IIT Kharagpur has its own strengths. In the integrated programme, you get a large campus, a wide exposure in the first year, since courses are shared with other departments, and the freedom to take electives from departments of your interest. Students who have studied there say that five years is enough time to build a profile in whichever direction you choose, including taking up non-physics roles through campus recruitment.
To decide, compare:
Talk to current students at both institutes, and ask what percentage move into research and what move into industry.
If you are still unsure about your direction, choose the place that keeps more doors open and where you will be most motivated to study.
No, it is not a mistake to prefer IISER Kolkata over IIT KGP for an MSc integrated course in Physics. You are going to get a pure science degree so it makes more sense to get the degree from an institute that focuses on that degree. IIT KGP is popular for its engineering degrees. So, you will be mostly surrounded by people who are pursuing engineering degrees. You won’t get to meet many like-minded students. The course structure of integrated MSc at IITs is also outdated.
At IISER Kolkata, you will get a decent course structure and better faculties for an integrated MSc.