Internal search index removed

Post Reply
User avatar
solarchat
Site Admin
Site Admin
Posts: 4355
Joined: Sat Feb 01, 2014 3:10 pm
Location: Atlanta, GA USA
Has thanked: 83 times
Been thanked: 1304 times
Contact:

Internal search index removed

Post by solarchat »

You may have noticed that there is no longer a search bar internal to the forum.
In order to have an internal search engine, the forum contents are indexed and additional database space is used that is the same size as the text in the forum. This is what is searched.

Last month we reached the maximum usage of the largest database that can be purchased through our host Network Solutions. The options were to archive older posts, delete older posts, or just remove the internal search engine which is what I did. This gave us 50% free space in the database and hopefully 10 more years of space.

it is just as easy and probably more accurate to simply use your favorite search engine externally to search for posts in this forum. We have search crawlers and bots on here 24 hours a day making their own indexes of our contents for your favorite search engines.

If you type the phrase “Solarchat” followed by whatever topic or term you are looking for, you will get dozens of responses in your search engine which you can then click and it will take you right to the post.

The below image are the results from me typing “Solarchat Daystar Quark” into my Google search engine.
D3E1653D-301F-4157-B155-EBB73EA94E8F.png
D3E1653D-301F-4157-B155-EBB73EA94E8F.png (857.14 KiB) Viewed 2458 times
If someone has a better idea and is willing to pay for this idea to be implemented or if someone just wants to take over the forum and run it themselves anyway they like, please let me know.


Stephen W. Ramsden
Atlanta, GA USA
Founder/Director Charlie Bates Solar Astronomy Project
http://www.solarastronomy.org
User avatar
marktownley
Librarian
Librarian
Posts: 42131
Joined: Tue Oct 18, 2011 5:27 pm
Location: Brierley Hills, UK
Has thanked: 20240 times
Been thanked: 10112 times
Contact:

Re: Internal search index removed

Post by marktownley »

Sounds a sensible idea Stephen.


Image
http://brierleyhillsolar.blogspot.co.uk/
Solar images, a collection of all the most up to date live solar data on the web, imaging & processing tutorials - please take a look!
User avatar
GreatAttractor
Almost There...
Almost There...
Posts: 964
Joined: Sat Jun 01, 2013 1:04 pm
Location: Switzerland
Has thanked: 747 times
Been thanked: 753 times

Re: Internal search index removed

Post by GreatAttractor »

In case of Google (and similarly other engines, I imagine) there's the function to search a particular website only; for our case, use:

Code: Select all

site:solarchatforum.com my search terms


My software:
Stackistry — an open-source cross-platform image stacker
ImPPG — stack post-processing and animation alignment
My images

SW Mak-Cass 127, ATM Hα scopes (90 mm, 200 mm), Lunt LS50THa, ATM SSM, ATM Newt 300/1500 mm, PGR Chameleon 3 mono (ICX445)
EGRAY_OBSERVATORY
Way More Fun to Share It!!
Way More Fun to Share It!!
Posts: 6876
Joined: Mon May 18, 2020 4:45 pm
Location: Essex, S.E.England
Been thanked: 4908 times

Re: Internal search index removed

Post by EGRAY_OBSERVATORY »

Many thanks Stephen for your efforts.

Terry


User avatar
DeepSolar64
Way More Fun to Share It!!
Way More Fun to Share It!!
Posts: 18728
Joined: Thu Sep 05, 2019 12:19 am
Location: Lowndesville S.C.
Has thanked: 17458 times
Been thanked: 16556 times

Re: Internal search index removed

Post by DeepSolar64 »

Thanks Stephen! Your efforts are appreciated here.


Lunt 8x32 SUNoculars
Orion 70mm Solar Telescope
Celestron AstroMaster Alt/Az Mount
Meade Coronado SolarMax II 60 DS
Meade Coronado SolarMax II 90 DS
Meade Coronado AZS Alt/Az Mount
Astro-Tech AT72EDII with Altair solar wedge
Celestron NexStar 102GT with Altair solar wedge
Losmandy AZ8 Alt/Az Mount
Sky-Watcher AZGTI Alt-Az GoTo mount
Cameras: ZWO ASI178MM, PGR Grasshopper, PGR Flea
Lunt, Coronado, TeleVue, Orion and Meade eyepieces

Image Visual Observer
" Way more fun to see it! "
User avatar
MapleRidge
Way More Fun to Share It!!
Way More Fun to Share It!!
Posts: 10173
Joined: Fri Jan 13, 2012 11:58 pm
Location: Cambray, ON Canada
Has thanked: 64 times
Been thanked: 4300 times
Contact:

Re: Internal search index removed

Post by MapleRidge »

This seems to be a very reasonable compromise to keep space available.

Brian


Brian Colville

Maple Ridge Observatory
Cambray, ON Canada

Photos: https://www.flickr.com/photos/185395281@N08/albums

10'x15 Roll-off Roof Observatory
Takahashi EM400 Mount carrying:
C14 + Lunt 80ED
Deep Sky Work - ASI294MM Pro+EFW 7x36/Canon 60D (Ha mod), ONAG
Planetary Work - SBIG CFW10, ASI462MM

2.2m Diameter Dome
iOptron CEM70G Mount carrying:
Orion EON 130ED, f7 OTA for Day & Night Use
Ha Setup: Lunt LS80PT/LS75FHa/B1200Ha + Home Brew Lunt Double Stack/B1800Ha on the Orion OTA + Daystar Quantum
WL, G-Band & CaK Setup: Lunt Wedge & Lunt B1800CaK, Baader K-Line and Altair 2nm G-Band filter
ASI1600MM, ASI432MM, ASI294MM Pro, ASI174MM, ASI462MM
User avatar
MalVeauX
Way More Fun to Share It!!
Way More Fun to Share It!!
Posts: 1853
Joined: Tue May 09, 2017 7:58 pm
Location: Florida
Has thanked: 1142 times
Been thanked: 1329 times

Re: Internal search index removed

Post by MalVeauX »

Hi,

Some thoughts:

A big reason the space is enormous is due to hosting images (large GIFs especially) and any video. From a pure text stand point, the data size is small even when duplicated for backups, etc. If size constraints are a problem, consider to stop hosting images and instead just require people host their own images and embed or link to them; many people do this already anyways. People can host on IMGUR, Flickr, Astrobin, etc since they're already doing this mostly.

Killing the search capabilities of the text in the forum is more detrimental to the actual information people are searching for, than removing hosting of images and media. Few people search for a specific image or need images from 10+ years ago. But there's plenty of information in text form that is critical and important that is very old, and finding that information is more important than finding an image. Sure, one can just point google or another search engine at the forum (if its been recently indexed by the search engine, this doesn't work otherwise) to find some things and it does work. It just seems that turning this off to have old images that are hosted that are not searched up by users (just search index bots usually) favors one thing when the most important stuff here is the information in text form.

As for stopping spam, the only form of spam that will show up is in the form of a user-bot that then posts. These can be completely nullified a two step process of 1) human data input as part of the registration (such as to reach a passage and answer a question, or simply describe why you are joining, etc) followed by 2) user accounts are activated by a mod/admin so that they're reviewed before they're given the ability to post. There's no "pay for security" involved with this part. Ad spam is abased on having ads, which are not present here, so that's a non-issue.

The data base would be tiny.
There would be minimal/no issues with bots (just index bots from search engines as guests crawling the forum).
The costs would be low. Just basic hosting services and backup services.

Very best,


User avatar
GreatAttractor
Almost There...
Almost There...
Posts: 964
Joined: Sat Jun 01, 2013 1:04 pm
Location: Switzerland
Has thanked: 747 times
Been thanked: 753 times

Re: Internal search index removed

Post by GreatAttractor »

MalVeauX wrote: Sat Oct 16, 2021 7:13 pm Few people search for a specific image or need images from 10+ years ago. But there's plenty of information in text form that is critical and important that is very old, and finding that information is more important than finding an image.
I must disagree. Images are not only the "today's full disc" or "another take on sunspot XYZ, day 10", but also irreplaceable things like "here are the results of disassembly and analysis of gear X", "my adapters to make mod Y", "my spectrum of filter Z", "astrophotography results with different settings" etc. Making people host these on external sites just won't work, the links will go dead, services go out of business/switch to fully-paid accounts, people lose interest and delete their profiles etc., etc. I think it's hugely important that I can look up a 10-year old telescope mod and have all the data still in one place; the optical/mechanical things don't become outdated quickly.


My software:
Stackistry — an open-source cross-platform image stacker
ImPPG — stack post-processing and animation alignment
My images

SW Mak-Cass 127, ATM Hα scopes (90 mm, 200 mm), Lunt LS50THa, ATM SSM, ATM Newt 300/1500 mm, PGR Chameleon 3 mono (ICX445)
EGRAY_OBSERVATORY
Way More Fun to Share It!!
Way More Fun to Share It!!
Posts: 6876
Joined: Mon May 18, 2020 4:45 pm
Location: Essex, S.E.England
Been thanked: 4908 times

Re: Internal search index removed

Post by EGRAY_OBSERVATORY »

I totally agree with you Filipp /GreatAttractor and to loose any archives containing information for those of us that want to find-out about what has happened in the past for mods etc., is very important.

Unfortunately the storage space required - does cost money to keep these files and their images in one place/SolarChat. This has not been sufficiently forthcoming of recent, so again, for us to be able to go back in time to see such info, does require sufficient-donations to allow this to happen...

Best Wishes
Terry


User avatar
Montana
Librarian
Librarian
Posts: 34526
Joined: Mon Oct 17, 2011 5:25 pm
Location: Cheshire, UK
Has thanked: 17521 times
Been thanked: 8763 times

Re: Internal search index removed

Post by Montana »

Filip, where do you find 'Code select all' in Google?

Alexandra


Post Reply