Oh yes, this is an exciting day! I present to you what I've
been working on all week.
https://www.jappleng.com/search">The
Jappleng Search.
It supports a lot of nice features and more to come. The more
people use it, the smarter it will get and content will become more
relevant. So many things have been added so let me explain...
1. There is no need to search for
@user or #tag. This is a search engine made from scratch
and it searches through all the text throughout the site to make
the searches possible.
3. Links to the Friend finder and the
Jappleng Dictionary is available from there.
4. If image results are found while
searching regularly, it will display a few images that
it found as a preview, and you can continue to the image search if
that's what you like.
5. Image Search function is
great! It lets you search through all the images hosted
on Jappleng given the permissions are set to public by the
uploader. Any information you add to the title, description,
filename and url is indexed.
6. Search results are sorted by
relevancy, and this score will change over time like any
major search engines. This means that it will only get better
starting today.
7. There is Safe Search!
Yes, there are 3 modes to safe search. If you keep it on, images /
posts / text that are NSFW will not appear in the search results.
If you you toggle it to moderate, you will see NSFW posts so long
as they are not images. Basically it blocks swearing. There are
over 200 swears and counting! The last mode, if you're brave... You
can disable safe search entirely and browse through the results
unfiltered.
Wait, what if you have Parental Controls turned on? Don't
worry! You will be told that you cannot see the mature content
because the Parental Controls are set in your Settings. This is to
avoid people sharing links with Safe-search tuned off and offend
people. Additionally, it is to prevent seeing something offensive
if you don't like it or if your account is hosted by a
parent.
Lastly, If you disable safe search, you will not see NSFW
images in the [All] tab of the search results. Instead, the images
will be blurred. You can see the unfiltered content by searching
through the [Images] tab.
8. You can see just how big Jappleng
is with this search. I have yet to not find content
based on the keywords that I have used. So.. Wow! Pretty enormous!
In fact, as of writing this... The index is at 94,603 unique terms
(4 characters or greater) spanning over 8,137 pages. I have removed
indexing of legacy forum posts for both the Sekai forums and the
original forums. This would have yielded irrelevant results and
increase the database size tremendously since there are tens of
thousands of legacy posts.
9. Please note that there is no
pagination system just yet. This is next on the list. So
you can only see a maximum of 25 results. Sorry for the
inconvenience but this search system took a lot longer than I had
expected it to. I also created a big back-end admin panel for this
with lots of scripts / A.I. stuff. It's crazy!
10. The list of upcoming
features:
- Ability to index everything inside the clubs
- Ability to index everything on J-Spot
- Ability to choose where to find results from (ie: Education
section only)
- Pagination System so that you can see more than 25 results
- Continue work on making the search engine better
- Search suggestions
- Automated search indexing instead of me clicking on a
button
- Inclusion of Jappleng dictionary definitions if the term is
found in the dictionary and perhaps other inclusions as time goes
by like understanding phraes like "how do I say x in
japanese?"
Here is the full update report!
November 6 Updates
[New Unlockables]
- ID Cover: The Witch and the Skeleton
[General]
- Word-based maturity filter has been created with over 200
words. This also automatically filters images that have NSFW words
but did not flag the image as NSFW. In the future, these images
will automatically be reported to the moderators for review.
Note: Only English and Japanese is supported, please help us
grow our foreign word check on discord.
[Jappleng Admin Search]
- I created an admin panel to do my search related tasks, it's
very comprehensive and includes scripts, A.I, tasks, analytics, a
console and so forth.
- All scripts have been updated to the point that they correctly
index every page now
[Jappleng Search]
- Search weights are now calculated, meaning search results are
relevant rather than random
- Resolved issue where users were not indexed
- Resolved issue where News items were not properly indexed
- Search database system has been optimized for better
performance
- Resolved issue where there was a critical error on search
pages
- Redesigned the Search page, it looks smooth
- Added new features including:
- + Image Search
- + Friend Finder
- + Jappleng Dictionary
- + Search by Category
- + Search settings include:
- + Parental Controls (3 levels: Safe Search On, Moderate,
Off)
- + Searches now include images at the top of the search if it
finds any images
- User Albums are now indexed if permission is granted to
(All)
- Club Albums are now indexed if permission is granted to
(All)
- Search Suggestions have been added, please be patient for
suggestion population, the way I designed the A.I. requires
trends.
- Word limit is now set to 8 from 3, max total chraracter remains
the same
- Made significant optimization in the indexing of keywords
- Search suggestion system (foundation) has been uploaded
- Search engine has been upgraded so that it can understand
search term relevancy
- Search results understand "Safe search" features
- Popup menu for Safe search Added under Settings
- All, Images, Friend Finder, Dictionary, Settings tab have been
added
- Image search is fully featured
- Image preview search during All search is possible
- If NSFW content is discovered and Safe Mode is off, blurred
images will appear during the preview search
- Safe search cannot be turned off unless the parental control
settings is set, a warning dialog prompts the user of this if they
try to disable the safe search and lack permission
- Resolved all indexing issues including link / title issues and
so forth
- All available sections have been re-indexed