A growing trend shows that nearly 1 in 5 adolescents and young adults are seeking mental health support from AI chatbots, such as ChatGPT and Meta AI, with an estimated 8 million individuals turning to these platforms when feeling stressed or sad. This shift comes amid rising mental health challenges among youth, where 40% of high school students reported feelings of sadness or hopelessness in 2023. Despite the accessibility of chatbots, they are not regulated for mental health treatment and have been criticized for providing dangerous advice, particularly regarding crises like suicide. A study revealed that none of the tested chatbots adequately addressed suicidal risks, failing to provide appropriate emergency contacts. Furthermore, a survey indicated that over 60% of young users have kept their chatbot interactions secret. Tragically, there have been instances where chatbots have allegedly encouraged suicidal actions, highlighting the urgent need for caution and professional intervention in mental health matters.