System and method for deep linking and search engine support for web sites integrating third party application and components
A method and system for a website building system (WBS) integrating at least one third party application includes detecting the presence of a spider associated with a search engine; parsing the output of said least one third party application to determine non-text components according to a request from said search engine spider, said non-text components having encoded or interleaved text, extracting said encoded or interleaved text from said non-text components; creating a search engine friendly page containing said extracted text; and providing said search engine friendly page to said spider.
1. A method for a website, the method comprising:
detecting the presence of a spider associated with a search engine;
receiving an incoming request from said spider via a uniform resource locator (URL);
extracting identifiers for at least one third party application (TPA) embedded as at least one instance in said website, said at least one TPA having mini pages and components;
reconstructing said URL as a permalink with said extracted identifiers, wherein said permalink includes deep links pointing to at least said mini pages in said at least one TPA;
forwarding said URL to said at least one TPA and requesting content according to said incoming request;
parsing the output of said least one TPA to determine at least non-text components according to a request from said search engine spider, said non-text components having contained text;
creating a search engine friendly page containing at least said components and mini-pages provided by said TPA with said extracted contained text; and
rendering said search engine friendly page to said spider.
2. The method according to claim 1 wherein said at least one TPA is at least one of: a single page and a multipage application.
3. The method according to claim 1 wherein said non-text components contain video.
4. The method according to claim 1 wherein said detecting is via at least one of: said spider originating IP, the request structure of said spider, the request header of said spider and the use of AJAX crawling URLs (uniform resource locators).
5. The method according to claim 1 wherein said creating a search engine friendly page comprises substituting HTML iframe tags with tags visible to said spider.
6. The method according to claim 1 wherein said request is at least one of: a manually entered URL of a specific page, the homepage of a requested site or a request to a general page redirected by said search engine.
7. The method according to claim 1 wherein said contained text is at least one of: encoded and interleaved.
8. A system for a website, the system comprising:
one or more processors configured to perform operations comprising: detecting the presence of and receiving an incoming request from a spider associated with a search engine via a uniform request locator (URL);
extracting identifiers for at least one third party application (TPA) embedded as at least one instance in said website, said at least one TPA having mini pages and components;
constructing said URL as a permalink with said extracted identifiers, wherein said permalink includes deep links pointing to at least said mini pages in said at least one TPA and forwarding said URL to said at least one TPA and requesting content according to said incoming request;
parsing the output of said least one TPA to determine non-text components according to a request from said search engine spider, said non-text components having contained text and to extract said text;
creating a search engine friendly page containing at least said components and mini pages provided by said TPA with said extracted contained text in formatted and optimized format; and
rendering said search engine friendly page to said spider.
9. The system according to claim 8 wherein said at least one TPA is at least one of: a single page and a multipage application.
10. The system according to claim 9 wherein said non-text components contain video.
11. The system according to claim 9 wherein said access type detector detects via at least one of: said spider originating IP, the request structure of said spider, the request header of said spider and the use of AJAX crawling URLs (uniform resource locators).
12. The system according to claim 9 wherein said renderer substitutes HTML iframe tags with tags visible to said spider.
13. The system according to claim 8 wherein said request is at least one of: a manually entered URL of a specific page, the homepage of a requested site or a request to a general page redirected by said search engine.
14. The system according to claim 8 wherein said contained text is at least one of: encoded and interleaved.