Oracle - Region under Discussion for Visual Dialog

Majority of the previous works in task-oriented systems, question generator used dialogue history to generate the next question in the conversation. So far, the understanding was dialogue history, along with answers aided in anticipating the best probable future question. There is also a paper on answer-driven visual estimation to improve the task success rate. However there is not much analysis on how the dialogue history is impacting the oracle’s responses. How oracle can use dialog history? This is the theme for today’s blog post. The blog post discusses about the paper, Region under Discussion for visual dialog

Read more

Question Generator - Hallucinating Entities in GuessWhat?!

True to its title, the paper, Hallucinating Entities in GuessWhat?! brings out how existing question generators hallucinating entities while conversing with the oracle. Hallucination referes to generating words that are not matching with source data. And these hallucinations creating a domino effect in the generated dialogues and degrading the overall quality of the system. Such systems are harmful to deploy in real-world as it persons with viewing disabilities value correctness over the fine-grained descriptions.

Read more

Question Generator - Human-Like Visual Dialogue Strategy

Taking the leap forward from the previous post, what are the other startegies humans follow? It is found that, we, humans usually follow confirmation-driven strategies when searching for an information (or) learning a new language. Inspired by this theory, a new approach is proposed to converse and locate object(s) in GuessWhat game. The blog post discusses about the paper Looking for Confirmations: An Effective and Human-Like Visual Dialogue Strategy.

Read more

Question Generator - Entity-based Strategy Learning and Augmented Guesser

One of the problems that was discussed in previous blog posts was, Question Generator is not aware of the objects in the image. Hence the questions start with categories and the dialog flows if ‘Yes’ is encountered along the line. Also during the trails, it was found humans usually start with entity based questions. How to equip question generator with entity information?

Read more

Question Generator - Unified Questioner Transformer

In the previous blog posts, the question generator almost always starting with entity/category questions and majority of other questions are spatial. However these kind of questions hit a block, if multiple objects share attributes, or the visual scene is complex. Also the Guesser targets a single object and does not consider the relationship among objects.

Read more

Exportober

Big thanks to Prof Dr. Neeldhara, for starting EXPORT (EXPress yOuR Thoughts) challenge with public accountability. This is the nudge I need after months of procrastination to update my tech blog.

Read more

Natural Language Processing Toolkits For Indian Languages

Indian Diaspora is rich in languages. According to a 2018 survey, 9 out of 10 new internet users will be Indian language users. Moreover, close to 70% of people consume content in local languages. With the rise in demand, enthusiasts, freelancers and organisations started focusing on developing NLP tools for the Indian languages.

This post aims in sharing the existing set of NLP tools and their usage

Read more

First Step

Finally got around to starting a blog on my #NLProc journey. Powered by Jekyll.
I would like to use this space to share my learnings, experiments, thoughts and opinions on #NLProc stuff.