Skip to content

Commit

Permalink
Add Facebook and IA crawler
Browse files Browse the repository at this point in the history
  • Loading branch information
luciomartinez committed Aug 21, 2024
1 parent e417ea2 commit d197a44
Showing 1 changed file with 16 additions and 5 deletions.
21 changes: 16 additions & 5 deletions src/parser-platforms.js
Original file line number Diff line number Diff line change
Expand Up @@ -18,9 +18,9 @@ export default [
},
},

/* Alexa */
/* AmazonBot */
{
test: [/ia_archiver/i],
test: [/Amazonbot/i],
describe() {
return {
type: PLATFORMS_MAP.bot,
Expand Down Expand Up @@ -62,13 +62,24 @@ export default [
},
},

/* Facebook */
/* Internet Archive Crawler */
{
test: [/ia_archiver/i],
describe() {
return {
type: PLATFORMS_MAP.bot,
vendor: 'Internet Archive',
};
},
},

/* Meta Web Crawler */
{
test: [/facebookexternalhit/i],
test: [/facebookexternalhit/i, /facebookcatalog/i],
describe() {
return {
type: PLATFORMS_MAP.bot,
vendor: 'Facebook',
vendor: 'Meta',
};
},
},
Expand Down

0 comments on commit d197a44

Please sign in to comment.