Hook nip05api into the nos.social host

Now that the nos_social Ansible script is merged, we need to integrate nip05api as a container in the role's Docker Compose. The API requires Redis, which can be hosted within the setup or offloaded to another host.

nip05api Integration: Add nip05api to docker-compose.yml, setting NODE_ENV to production. AUTH_PUBKEY and ROOT_DOMAIN are fine by default for nos.social but they can be set too for consistency.

Traefik Routing & DNS Setup: Implement routing with traefik.http.routers.nip05api.rule=HostRegexp({subdomain:[a-zA-Z0-9-]+}.nos.social). Ensure DNS configurations route all nos.social subdomains to nip05api, while redirect-service continues to serve requests to the naked domain.

Redis Configuration: Set REDIS_HOST in nip05api to link to a local or remote Redis instance as per requirement.

Automated Deployment: Establish a process to automatically deploy nip05api when a new Docker image is pushed to the repository.

@cooldracula let's wait for this, we are currently thinking about using some other domain for this service.

Per an update from @setch-l, nos.social was chosen as the domain, and I think the work on this ticket can continue.

@cooldracula to match the Request a deployment checklist I'm adding this:

Prod env
We don't have many users so I think that for the moment 8GB RAM will be fine for our Redis instance and it will last for a while. We'll also need to monitor Redis memory usage.
Keep in mind that Redis should be setup with persistence options.

I opened a PR(#72), that updates our traefik and nos_social roles to match these requirements.
I used the scripts to deploy social.ansible.fun, but held off on running it for nos.social as I want to make sure the redirects work as expected before making changes to this major site.
I'll go through the requirements and how they were done in this script, to check I have it correct:
1.) nip05api Integration: Add nip05api to docker-compose.yml, setting NODE_ENV to production. AUTH_PUBKEY and ROOT_DOMAIN are fine by default for nos.social but they can be set too for consistency.
I created an image from the current nip05api repo, using the existing dockerfile (though updated to node 18) and pushed it to my cooldracula registry (will clarify more in task 5).
We use this image in the updated vars in #72.  For AUTH_PUBKEY, I used the default value published in nip05api's config.
2.) Traefik Routing & DNS Setup: Implement routing with traefik.http.routers.nip05api.rule=HostRegexp({subdomain:[a-zA-Z0-9-]+}.nos.social). Ensure DNS configurations route all nos.social subdomains to nip05api, while redirect-service continues to serve requests to the naked domain.
This was tricky, but I think I have it.   Using social.ansible.fun as an example:
If I make a request to the API, e.g.
curl -L -H 'Host: social.ansible.fun' http://social.ansible.fun/.well-known/nostr.json\?name\=zach

It returns a json response, from the api:
{"error":"Name not found"}

If I visit an arbitrary subdomain, like https://foo.social.ansible.fun, I get the response:
Cannot GET /

Which is an error, but one coming from the API service.  I assumed this error made sense as the name resolution may not be implemented, especially for a random name?
If I visit https://social.ansible.fun/metrics, I get the metrics page created by the api service.
If i visit https://social.ansible.fun or https://social.ansible.fun/baz, I get a 404 page from webflow.  This tells me the traffic was directed to the redirect-service correctly, and it is using the redirect rule outlined in the nginx-redirect.conf, but I am not sure what the expected behaviour form webflow should be in this case.
Lastly, if I go to https://traefik.social.ansible.fun, we get our traefik dashboard (requires authentication, with the name and password stored in the role's vars and encrypted by ansible-vault).
So I am iffy on this section just because I am getting 404 and errors.  They are reasonable and coming from the right places, but still wanna confirm the behaviour.
3.) Redis Configuration: Set REDIS_HOST in nip05api to link to a local or remote Redis instance as per requirement.
I added redis to the docker compose for nos_social, with a persistent docker volume.  I think a local deployment makes sense, as we design a more standardized architecture for db's,caches, and backups, and having it be local both simplifies the deployment and reduces network lag for the cache.
4.) Hook /metrics to prometheus: Add a scrape job in Prometheus for nip05api to collect metrics from the /metrics endpoint.
There are two different metrics created with this deployment that we can easily hook up to prometheus.  I did not do it for social.ansible.fun as it is a dev server.
Our scripts install node-exporter, available at http://social.ansible.fun:9100/metrics.  This has a custom health check added that pings the application's metrics endpoint.  If it doesn't return 200, then there is some issue with our application or routing.
We also have the application-specific metrics at https://social.ansible.fun/metrics
5.) Automated Deployment: Establish a process to automatically deploy nip05api when a new Docker image is pushed to the repository.
I added a PR to the nip05api repo (https://github.com/planetary-social/nip05api/pull/4) with a workflow for building and pushing docker images (along with a simple nix dev environment).  As the nip05api repo is private, I set the workflow to push to my cooldracula repo.  We will want to adjust the settings of the repo to have packages be public, or make the whole repo public, so we can publish to ghcr.io instead.
There is a service on the server to pull any image updates and restart the services when a new image is pulled.
Lastly, I updated the new-server-vars to use a droplet with 8gb ram.  It is a sizable and relatively pricy droplet with that much ram ($48/month), but our overall server costs are fairly low.
If the PR's referenced in this ticket look good and the redirections for social.ansible.fun are working as generally expected, then I could run the scripts for nos.social itself.

I've deployed the service for nos.social, with the redirect to webflow for the bare domain.
I added the metrics for the application to prometheus, with the name nos_social, as well as the node_exporter metrics for the machine itself.
DNS seems to have propogated correctly and the bare domain is redirectly appropriately.
I think this general ticket can be closed, but new ones may open as we figure out the finer details of the api?


svg can't get the correct clip-path if url contains ')' or '('

et: <path clip-path="url(https://xxx.com?keyword=(1)#mask-145)

great find! Probably need to do better escaping on the clip path to address this.

great find! Probably need to do better escaping on the clip path to address this.

great find! Probably need to do better escaping on the clip path to address this.

maybe use cli-path style like 'clip-path: path('M 0 200 L 0,75 A 5,5 0,0,1 150,75 L 200 200 z');' is a better choice?

great find! Probably need to do better escaping on the clip path to address this.

maybe use cli-path style like 'clip-path: path('M 0 200 L 0,75 A 5,5 0,0,1 150,75 L 200 200 z');' is a better choice?

:tada: This issue has been resolved in version 3.0.2 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Added SynCode in Python Libraries.

Dear Awesome LLM JSON authors,
Hello, this is the author of SynCode. I thought that SynCode also fits the criteria of the Python Library part in your repository. I have added SynCode to the list of Python libraries.
Thank you for your work.
Sincerely,
SynCode.

Cool simple library! Thanks!


Tests don't pass because of flake8 E501 line too long

Tests run on 0.10.4 and 0.10.5.
FAIL: test_flake8 (tests.TestFlake8)
Test that we conform to PEP-8.
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/build/holidays-0.10.5/tests.py", line 35, in test_flake8
    self.assertEqual(self.report.get_statistics('E'), [])
AssertionError: Lists differ: ['1 E501 line too long (82 > 79 characters)'] != []

First list contains 1 additional elements.
First extra element 0:
'1 E501 line too long (82 > 79 characters)'

- ['1 E501 line too long (82 > 79 characters)']
+ []

----------------------------------------------------------------------
Ran 579 tests in 23.641s

Hi,
I'm trying to reproduce this issue, but no luck, either calling
flake8
directly and either via
coverage run --omit=*site-packages* tests.py TestFlake8
Please let me know if you have any further details, thank you very much!

It seems to happen here:
/build/holidays-<IP_ADDRESS>/holidays/__init__.py:15:80: E501 line too long (82 > 79 characters)

https://github.com/dr-prodigy/python-holidays/blob/cb875fb87e91f8c555966659bca1636519c47d6f/holidays/__init__.py#L15

And it seems you are not seeing this, because you have excluded this file, but somehow that exclusion doesn't work for us when running the tests.
https://github.com/dr-prodigy/python-holidays/blob/master/.flake8#L3

Oh I see.. that's pretty weird: flake8 is in fact instructed by .flake8 file to skip some warnings / files (most notably init.py), which works both in local and on Travis CI since a large number of past releases.
Fixing that long row is easy and I will do it (thank you for your details btw) but still, if .flake8 file is ignored for any reason, some other issues should than arise, such as:
./holidays/__init__.py:13:1: F403 'from holidays.countries import *' used; unable to detect undefined names

Any ideas?

No idea. Though the flake8 test has its own style guide, too. Not sure how that influences the .flake8 file.

Ok, np.. in the meantime, I released the fix on beta. Thx cheers


Does not automatically save the file that I write

When I press save, it does not save. I want to turn on automatic save.

This may be unrelated, but while running the latest version of Atom on macOS Catalina, I could not save. Even quitting the app & responding to the modal that asks you to save wouldn't let me save a file. Safe mode didn't work for me, but clearing the saved state worked. https://flight-manual.atom.io/hacking-atom/sections/debugging/


Don't use compilation features

We have features for:

consensus algos
allocators
db selection

And we have to do a bunch of cross-feature testing https://github.com/ChainSafe/forest/blob/f9bb27c2900a8c5731019798053ceb6de162a6d8/Makefile#L92-L107
Features should also be additive - ours are not. This is why we have to do all that cross-feature checking. We should be able to lint with --all-features and have it just work
Conditional compilation is often used for:

Optional functionality in resource constrained environments (think no_std, or users who are particularly sensitive to binary sizes)
Opt-in integration with other crates (tokio, serde, arbitrary)
Platform-specific implementations (unix vs windows, pointer width)

We don't fit into any of these:

Any user running forest clearly doesn't care about bundle size
We're a CLI, not a library, don't need to optionally integrate with serde
Any user probably doesn't have an allocator preference - we should just profile the best one and use that
Any user probably doesn't have a db preference -  we should just profile the best one and use that

If they do, then we should just use traits, not have optional modules - that's the wrong abstraction

We should just use traits for the cns stuff too

List of compilation features:

rocksdb
paritydb
jemalloc
mimalloc
rustalloc
insecure_post
forest_fil_cns
forest_deleg_cns
instrumented_kernel
lz4
test_vectors

https://github.com/ChainSafe/forest/blob/6b3db608936f22db9df80ca2f8bd2d3131510568/src/db/rocks.rs#L38-L73
Ouch

Remaining features:

instrumented_kernel
insecure_post
doctest-private
benchmark-private
rustalloc
jemalloc
mimalloc

Let's get rid of instrumented_kernel and insecure_post and keep the rest.

Done.


Set up cache for items in the search result

The original attempt to fix the bug with read/unread status (#137) was quite far from the good solution, so I've decided to rewrite it from scratch.
I'm looking forward for feedback, especially on the test.

Coverage decreased (-1.3%) to 26.529% when pulling bc5c2ef73d684327290c6bc36d8e013c4090440b on ahitrin:search-new-fix into b7cb95ea8285e5e0a73fb2d670f7a86778d2b5d6 on akrennmair:master.

The code looks perfectly fine to me. Thank you!


Documentation on assign a value and vectorized indexing

I was trying to assign a value to a dataset and kept getting no error but also not getting what I wanted.
I then was directed to the Warning at the end of the Assigning values with indexing and I realized I wasted a lot of time on something that is not possible.
So I am suggesting a few improvements (some might be feasible, some might not):
A) I am not sure if it is possible, but maybe add a proper error to such thing - try to assign values when using any of the indexing methods - would be great.
B) if A is not possible, maybe in the DataArray page you should repeat the Warning. In this second page, in fact, you state: "Select or assign values by integer location (like numpy) : x[:10] or by label (like pandas): x.loc['2014-01-01'] or x.sel(time='2014-01-01')." Which I think it's in contradiction, or at least it's not crystal clear.
C) you should add to the text of the Warning to use vectorized indexing, so people know how to fix the issue.
D) Also for the vectorized indexing page, an example using .sel could help. For example, something like the following, which I think it should work (using your same dataArray within the vectorized indexing help)
ind_x = da.x==0

ind_y = da.y=='c'

da[ind_x, ind_y] =30

E) If I am completely off in the solution that i used in the code above, then add an example that takes care of this. In your examples you use 0s and 1s, which is not what you want to do if you have multiple lat and lon and time coordinates that you want to use correctly.
I hope I made some sense..

A) I am not sure if it is possible, but maybe add a proper error to such thing - try to assign values when using any of the indexing methods - would be great.

Yes, totally agreed that this would be ideal, but unfortunately I don't think this is possible. Pandas attempted something with its SettingWithCopy warnings, but in most cases I think those just add noise and warm about something that isn't actually a problem.

B) if A is not possible, maybe in the DataArray page you should repeat the Warning.

I don't know if it makes sense on the overview page for DataArray, but we should definitely repeat it on the doc page for DataArray.sel:
http://xarray.pydata.org/en/stable/generated/xarray.DataArray.sel.html

C) you should add to the text of the Warning to use vectorized indexing, so people know how to fix the issue.

Yes, agreed!
D) Also for the vectorized indexing page, an example using .sel could help. For example, something like the following, which I think it should work (using your same dataArray within the vectorized indexing help)
Yes, I think we should add an example of using vectorized indexing for assignment.
We already have some examples of using it with .sel() further down the page, but I agree that label-based indexing should probably be more strongly emphasized: http://xarray.pydata.org/en/stable/indexing.html#more-advanced-indexing

Regarding B)
I think that the current text can lead to confusion:

Select or assign values by integer location (like numpy): x[:10] or by label (like pandas): x.loc['2014-01-01'] or x.sel(time='2014-01-01').

because selecting and assigning are discussed together. I think that should be fixed too.

because selecting and assigning are discussed together. I think that should be fixed too.

Agreed, it is confusingly worded. I missed that when I reread it earlier.
If you're interested in tackling any of these issues, pull requests would be gratefully accepted!  See here for guidelines:
http://xarray.pydata.org/en/stable/contributing.html#contributing-to-the-documentation

I finally had the time to try out this SO suggestion on assigning on multiple dimensions as well (imaging being in need to modify the forcing of a model for a selected area) and it works. These are quite peculiar ways (at least for people not deep into xarray...) to assign values; I am compiling a list of them which IMHO should be added somewhere in the help. I will post them here for discussion, and to make sure they are indeed the most correct way to do it!

For example, using the tutorial data:
ds = xr.tutorial.load_dataset('air_temperature')
#add an empty 2D dataarray
ds['empty']= xr.full_like(ds.air.mean('time'),fill_value=0)
#modify one grid point, using where() or loc()
ds['empty'] = xr.where((ds.coords['lat']==20)&(ds.coords['lon']==260), 100, ds['empty'])
ds['empty'].loc[dict(lon=260, lat=30)] = 100
#modify an area with where() and a mask
mask = (ds.coords['lat']>20)&(ds.coords['lat']<60)&(ds.coords['lon']>220)&(ds.coords['lon']<260)
ds['empty'] = xr.where(mask, 100, ds['empty'])
#modify an area with loc()
lc = ds.coords['lon']
la = ds.coords['lat']
ds['empty'].loc[dict(lon=lc[(lc>220)&(lc<260)], lat=la[(la>20)&(la<60)])] = 100

these are examples that I am pretty sure are not on the website, they are I think common in climate scientists workflow, and that it took me quite a while to figure out. I was using a boolean dataarray as well as in the SO example, slowing down my work of quite a bit.
Do they make sense? I can try and add them to the documentation at Assigning Values with indexing , or is there another place that is more relevant?

@chiaral Yes, I think that would be a good place to add the example of assigning with .loc.
The where example might be better added to the section on where: http://xarray.pydata.org/en/v0.10.3/indexing.html#masking-with-where

Actually, on further consideration it is probably best to organize the narrative documentation by task/goal (user need), rather than xarray's internal organization of methods (the API docs are for this). So integrating this in the section on "Assigning values with indexing" makes sense for both of these.
Feel free to reorganize the existing material. I think showing how to assign with .loc is more important than combined indexing with in-place arithmetic, for example.


Fix crashes.

Fixes https://github.com/artsy/eigen/issues/1616, https://github.com/artsy/eigen/issues/1667, and https://github.com/artsy/eigen/issues/1670. It might fix https://github.com/artsy/eigen/issues/1619, but that’s just a guess atm.

Self-merging.


Make offset/length optional for "gen" entry

Since these fields were required in V1, I'm guessing it is OK to include here in the spec. Fixes #19

I am in favour. I would like other opinions too, if possible, particularly about whether this "breaks" the spec and needs a new version.

Apologies for opening the linked PRs preemptively. Also in favor of hearing input from others first! Thanks

OK, I see no objection, so I am merging this.


How to generate densecap json file?

Hi, I wanted to know how to generate this file "densecap/img_caption.json".
Also I am trying to write an inference script for the best-model.pth file provided. Should I load the state dict of the weights into densepembedAttModel model class provided in the scripts?

Can you also provide the config parameters used in the model? I cant find the Opt dictionary anywhere

Hey Shreyas,
Thanks for reaching out and I will try to provide more instructions on this
coming weekends.
On Sat, Mar 11, 2023, 10:08 AM Shreyas SK @.***> wrote:

Can you also provide the config parameters used in the model? I cant find
the Opt dictionary anywhere
—
Reply to this email directly, view it on GitHub
https://github.com/cici-ai-club/3M/issues/3#issuecomment-1464931247, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AI5ABMKTOKJIYSFGTQEOXVTW3SIQBANCNFSM6AAAAAAVXQ7ETU
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

Hi, Just leaving a comment as a reminder. Please try to provide instructions this weekend. Thanks

Hi, Just leaving a comment as a reminder. Please try to provide instructions this weekend. Thanks

Hi Shreyas,
I followed the below repo to generate densecap/img_caption.json
The format should be like {"image_name":image_features}, image_features are directly extracted from the model from the below repo using the PERSONALITY CAPTION dataset.
https://github.com/jcjohnson/densecap
If you need my densecap/img_caption.json for the PERSONALITY CAPTION dataset, I have some generated ones already, they cannot be directly shared through GitHub due to their size. If you need, I might have to see if other places offer free space for me to upload. Let me know if you need that, I can help to upload it if I found some free storage. The original places I uploaded in README have expired already.

Hi,
Thanks for the information. Can you please figure out a way to share the
already generated file. I'll let you know once I download it. You can later
remove it as its difficult to get free storage now a days.
Thanks and regards
Shreyas
On Sun, 19 Mar 2023, 10:13 CAIC, @.***> wrote:

Hi, Just leaving a comment as a reminder. Please try to provide
instructions this weekend. Thanks
Hi Shreyas,
I followed the below repo to generate densecap/img_caption.json
The format should be like {"image_name":image_features}, image_features
are directly extracted from the model from the below repo using the
PERSONALITY CAPTION dataset.
https://github.com/jcjohnson/densecap
https://github.com/jcjohnson/densecap
If you need my densecap/img_caption.json for the PERSONALITY CAPTION
dataset, I have some generated ones already, they cannot be directly shared
through GitHub due to their size. If you need, I might have to see if other
places offer free space for me to upload. Let me know if you need that, I
can help to upload it if I found some free storage. The original places I
uploaded in README have expired already.
—
Reply to this email directly, view it on GitHub
https://github.com/cici-ai-club/3M/issues/3#issuecomment-1475102359, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AKREPDNEXKXQYBZDPHNB2LDW42FGZANCNFSM6AAAAAAVXQ7ETU
.
You are receiving this because you authored the thread.Message ID:
@.***>

Hi, Thanks for the information. Can you please figure out a way to share the already generated file. I'll let you know once I download it. You can later remove it as its difficult to get free storage now a days. Thanks and regards Shreyas
…
On Sun, 19 Mar 2023, 10:13 CAIC, @.> wrote: Hi, Just leaving a comment as a reminder. Please try to provide instructions this weekend. Thanks Hi Shreyas, I followed the below repo to generate densecap/img_caption.json The format should be like {"image_name":image_features}, image_features are directly extracted from the model from the below repo using the PERSONALITY CAPTION dataset. https://github.com/jcjohnson/densecap https://github.com/jcjohnson/densecap If you need my densecap/img_caption.json for the PERSONALITY CAPTION dataset, I have some generated ones already, they cannot be directly shared through GitHub due to their size. If you need, I might have to see if other places offer free space for me to upload. Let me know if you need that, I can help to upload it if I found some free storage. The original places I uploaded in README have expired already. — Reply to this email directly, view it on GitHub <#3 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKREPDNEXKXQYBZDPHNB2LDW42FGZANCNFSM6AAAAAAVXQ7ETU . You are receiving this because you authored the thread.Message ID: @.>
Sure, let me try to find and upload them. Then I will let you know

Also I am trying to write an inference script for the best-model.pth file
provided. Should I load the state dict of the weights into
densepembedAttModel model class provided in the scripts?
Thanks and regards
Shreyas
On Sun, 19 Mar 2023, 10:39 CAIC, @.***> wrote:

Hi, Thanks for the information. Can you please figure out a way to share
the already generated file. I'll let you know once I download it. You can
later remove it as its difficult to get free storage now a days. Thanks and
regards Shreyas
… <#m_2462865647210755363_>
On Sun, 19 Mar 2023, 10:13 CAIC, @.> wrote: Hi, Just leaving a comment
as a reminder. Please try to provide instructions this weekend. Thanks Hi
Shreyas, I followed the below repo to generate densecap/img_caption.json
The format should be like {"image_name":image_features}, image_features are
directly extracted from the model from the below repo using the PERSONALITY
CAPTION dataset. https://github.com/jcjohnson/densecap
https://github.com/jcjohnson/densecap
https://github.com/jcjohnson/densecap
https://github.com/jcjohnson/densecap If you need my
densecap/img_caption.json for the PERSONALITY CAPTION dataset, I have some
generated ones already, they cannot be directly shared through GitHub due
to their size. If you need, I might have to see if other places offer free
space for me to upload. Let me know if you need that, I can help to upload
it if I found some free storage. The original places I uploaded in README
have expired already. — Reply to this email directly, view it on GitHub <#3
(comment)
https://github.com/cici-ai-club/3M/issues/3#issuecomment-1475102359>, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AKREPDNEXKXQYBZDPHNB2LDW42FGZANCNFSM6AAAAAAVXQ7ETU
https://github.com/notifications/unsubscribe-auth/AKREPDNEXKXQYBZDPHNB2LDW42FGZANCNFSM6AAAAAAVXQ7ETU
. You are receiving this because you authored the thread.Message ID: @.>
Sure, let me try to find and upload them. Then I will let you know
—
Reply to this email directly, view it on GitHub
https://github.com/cici-ai-club/3M/issues/3#issuecomment-1475107540, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AKREPDMCHQSH6M5MXZ5K4K3W42IKFANCNFSM6AAAAAAVXQ7ETU
.
You are receiving this because you authored the thread.Message ID:
@.***>

Also I am trying to write an inference script for the best-model.pth file provided. Should I load the state dict of the weights into densepembedAttModel model class provided in the scripts? Thanks and regards Shreyas
…
On Sun, 19 Mar 2023, 10:39 CAIC, @.> wrote: Hi, Thanks for the information. Can you please figure out a way to share the already generated file. I'll let you know once I download it. You can later remove it as its difficult to get free storage now a days. Thanks and regards Shreyas … <#m_2462865647210755363_> On Sun, 19 Mar 2023, 10:13 CAIC, @.> wrote: Hi, Just leaving a comment as a reminder. Please try to provide instructions this weekend. Thanks Hi Shreyas, I followed the below repo to generate densecap/img_caption.json The format should be like {"image_name":image_features}, image_features are directly extracted from the model from the below repo using the PERSONALITY CAPTION dataset. https://github.com/jcjohnson/densecap https://github.com/jcjohnson/densecap https://github.com/jcjohnson/densecap https://github.com/jcjohnson/densecap If you need my densecap/img_caption.json for the PERSONALITY CAPTION dataset, I have some generated ones already, they cannot be directly shared through GitHub due to their size. If you need, I might have to see if other places offer free space for me to upload. Let me know if you need that, I can help to upload it if I found some free storage. The original places I uploaded in README have expired already. — Reply to this email directly, view it on GitHub <#3 (comment) <#3 (comment)>>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKREPDNEXKXQYBZDPHNB2LDW42FGZANCNFSM6AAAAAAVXQ7ETU https://github.com/notifications/unsubscribe-auth/AKREPDNEXKXQYBZDPHNB2LDW42FGZANCNFSM6AAAAAAVXQ7ETU . You are receiving this because you authored the thread.Message ID: @.> Sure, let me try to find and upload them. Then I will let you know — Reply to this email directly, view it on GitHub <#3 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKREPDMCHQSH6M5MXZ5K4K3W42IKFANCNFSM6AAAAAAVXQ7ETU . You are receiving this because you authored the thread.Message ID: @.**>
Hi Shreyas,
I have uploaded densecap/img_caption.json to the below drive, and make sure you create a folder called densecap and put the file inside it. The trained model is also inside the drive and specifically inside log_added_new, download them, follow my instruction in the readme, and you should able to execute all steps.
https://drive.google.com/drive/u/4/folders/170palQ7QzRsY2ZRyaDTIQAcdHyuVZsFe

Hi Shreyas,
I have uploaded densecap/img_caption.json to the below drive, and make sure you create a folder called densecap and put the file inside it. The trained model is also inside the drive and specifically inside log_added_new, download them, follow my instruction in the readme, and you should able to execute all steps.
https://drive.google.com/drive/u/4/folders/170palQ7QzRsY2ZRyaDTIQAcdHyuVZsFe

Hi Shreyas,
I have uploaded densecap/img_caption.json to the below drive, and make sure you create a folder called densecap and put the file inside it. The trained model is also inside the drive and specifically inside log_added_new, download them, follow my instruction in the readme, and you should able to execute all steps.
https://drive.google.com/drive/u/4/folders/170palQ7QzRsY2ZRyaDTIQAcdHyuVZsFe

Thank you! I'll let you know once I download the file

Hi Cheng,
Thanks for all the help. I was able to create an inference script using the best-model.pth artifact provided. However the generated captions doesn't make much of sense for each personality trait. I have mentioned one of the sample below. I'm not sure if I'm missing out something. Please help me out
Trait - Intense
Generated Caption :-  this shocked the critter beautiful knees i ' ve towels seen in my famous growing !
Ground Truth Caption:- the snow will last as long as my sadness

Inference Code
`
ofc_feats = ds[index][0].to(device)
oatt_feats = ds[index][1].unsqueeze(0).to(device)
dcap = ds[index][2]
dcap = torch.from_numpy(np.int32(dcap)).to(device).unsqueeze(0)
attention_mask = torch.ones(1, 8)
traits = torch.from_numpy(np.int32(ds[index][4])).to(device).unsqueeze(0)
pred, _= model._sample_beam(ofc_feats, oatt_feats, dcap, attention_mask, personality=traits)
pred = pred.detach().cpu().numpy().tolist()
g_cap = " ".join(data[index]["sentence"][0])
id = traits.detach().cpu().numpy()
personality_index = np.where(id==1)[1][0]
personality = ds.info["pix_to_personality"][str(personality_index)]
g_personality = data[index]["personality"]
cap = ""
for i in pred[0]:
if i != 0:
cap = cap + " " + id2word["ix_to_word"][str(i)]
print(f"Generated Caption for Personality: {personality} is :- {cap}\n")
print(f"Ground Truth Caption for Personality: {g_personality} is:- {g_cap}")
image_name = data[index]["id"]+".jpg"
Image.open(f"../ParlAI/images/train_images/{image_name}")`

Hey I am not sure if you use the same personality index as mine. Please
first make sure everything there is correct. Please try some simple one,
like happy, sad first.
Try the test data from my dataset first to verify things.
Thank you.
Chengxi
On Wed, Mar 29, 2023 at 12:27 AM Shreyas SK @.***>
wrote:

Hi Cheng,
Thanks for all the help. I was able to create an inference script using
the best-model.pth artifact provided. However the generated captions
doesn't make much of sense for each personality trait. I have mentioned one
of the sample below. I'm not sure if I'm missing out something. Please help
me out
Trait - Intense
Generated Caption :- this shocked the critter beautiful knees i ' ve
towels seen in my famous growing !
Ground Truth Caption:- the snow will last as long as my sadness
[image: Screenshot 2023-03-29 at 12 53 42 PM]
https://user-images.githubusercontent.com/44189581/228457714-7106c1f2-a63b-4bc3-9aa3-2fd4adada43d.png
Inference Code
`
ofc_feats = ds[index][0].to(device)
oatt_feats = ds[index][1].unsqueeze(0).to(device)
dcap = ds[index][2]
dcap = torch.from_numpy(np.int32(dcap)).to(device).unsqueeze(0)
attention_mask = torch.ones(1, 8)
traits = torch.from_numpy(np.int32(ds[index][4])).to(device).unsqueeze(0)
pred, _= model._sample_beam(ofc_feats, oatt_feats, dcap, attention_mask,
personality=traits)
pred = pred.detach().cpu().numpy().tolist()
g_cap = " ".join(data[index]["sentence"][0])
id = traits.detach().cpu().numpy()
personality_index = np.where(id==1)[1][0]
personality = ds.info["pix_to_personality"][str(personality_index)]
g_personality = data[index]["personality"]
cap = ""
for i in pred[0]:
if i != 0:
cap = cap + " " + id2word["ix_to_word"][str(i)]
print(f"Generated Caption for Personality: {personality} is :- {cap}\n")
print(f"Ground Truth Caption for Personality: {g_personality} is:-
{g_cap}")
image_name = data[index]["id"]+".jpg"
Image.open(f"../ParlAI/images/train_images/{image_name}")`
—
Reply to this email directly, view it on GitHub
https://github.com/cici-ai-club/3M/issues/3#issuecomment-1488079508, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AI5ABMLQC67JITF5ZH76AMDW6PP7PANCNFSM6AAAAAAVXQ7ETU
.
You are receiving this because you commented.Message ID:
@.***>

I am using the same personality index as yours. I even tried with the test set but no luck. Still the generated captions doesn't make sense

The test set should make sense. I am not sure where goes wrong. You can
check with some happy personality with dog picture first to see if your
side works. Also check whether the caption you got make sense.
On Thu, Mar 30, 2023, 2:18 AM Shreyas SK @.***> wrote:

I am using the same personality index as yours. I even tried with the test
set but no luck. Still the generated captions doesn't make sense
—
Reply to this email directly, view it on GitHub
https://github.com/cici-ai-club/3M/issues/3#issuecomment-1489972913, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AI5ABMLHZUM473BPHT44KG3W6VFXVANCNFSM6AAAAAAVXQ7ETU
.
You are receiving this because you commented.Message ID:
@.***>

I have tried to evaluate using the test split but it seems this file is missing "data/person-test-words.p". Can you please upload it in the drive
File "/home/ec2-user/SageMaker/3M/denseeval3m.py", line 82, in
loss, split_predictions, lang_stats = eval_utils.eval_split(model, crit, loader, vars(opt))
File "/home/ec2-user/SageMaker/3M/deneval_utils3m.py", line 111, in eval_split
init_scorer('person-'+split+'-words')
File "/home/ec2-user/SageMaker/3M/misc/rewards.py", line 25, in init_scorer
CiderD_scorer = CiderD_scorer or CiderD(df=cached_tokens)
File "/home/ec2-user/SageMaker/3M/cider/pyciderevalcap/ciderD/ciderD.py", line 28, in init
self.cider_scorer = CiderScorer(n=self._n, df_mode=self._df)
File "/home/ec2-user/SageMaker/3M/cider/pyciderevalcap/ciderD/ciderD_scorer.py", line 80, in init
pkl_file = cPickle.load(open(os.path.join('data', df_mode + '.p'),'rb'), **(dict(encoding='latin1') if six.PY3 else {}))
FileNotFoundError: [Errno 2] No such file or directory: 'data/person-test-words.p'

If possible could you please upload the extracted features from ResNext?

Extracted Features is about 80 GB. It's too difficult to upload it. You can extract those features yourself easily.
You can take help from the below link to extract features. Just replace the model tag
https://huggingface.co/docs/timm/main/en/feature_extraction

Extracted Features is about 80 GB. It's too difficult to upload it. You can extract those features yourself easily. You can take help from the below link to extract features. Just replace the model tag https://huggingface.co/docs/timm/main/en/feature_extraction

How do I use the feature_extraction of Hugging_face instead of ParlAI? I am using ParlAI, however, not all the images are downloading. Due to this, the extraction process stops at a specific file.

I'm using only YFCC. You can find the json files of train, val and test sets from ParlAI. There are Image URLs in those files. Use them to download the complete dataset.

I understand we can use resnext101_32x48d_wsl to extract the mean pool features either using Hugging face or any other pre-trained ResNext. What about the spatial features (resnext101_32x48d_wsl_spatial_att)? I cannot find this model anywhere.

I believe the train, val, and test sets only contain information about the image hash. I can avoid the 50 files that are missing and extract the features using the images I have. However, ParlAI won't work unless I have the remaining files. Can you guide me with the commands you used for Hugging Face to extract mean pool features and spatial features?

Hey, yes ParlAI won't work unless you add some code to avoid those images.
All the missing ones I found is starting with ac8. So add code to avoid
ParlAI to generate features if hash contained ac8*.
On Mon, Apr 10, 2023, 7:21 AM Nischal Newar @.***>
wrote:

I believe the train, val, and test sets only contain information about the
image hash. I can avoid the 50 files that are missing and extract the
features using the images I have. However, ParlAI won't work unless I have
the remaining files. Can you guide me with the commands you used for
Hugging Face to extract mean pool features and spatial features?
—
Reply to this email directly, view it on GitHub
https://github.com/cici-ai-club/3M/issues/3#issuecomment-1501878416, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AI5ABMMNKMH5KN65DIYQC53XAQJNNANCNFSM6AAAAAAVXQ7ETU
.
You are receiving this because you commented.Message ID:
@.***>

I should be able to help this one. Have you figured it out? Also have you
tried to use preprocess steps I provided in the bash script.  Let me know
if you still need it.
I will have to upload to you in 1 week when I get back home.
Chengxi
On Sun, Apr 2, 2023, 2:38 AM Shreyas SK @.***> wrote:

I have tried to evaluate using the test split but it seems this file is
missing "data/person-test-words.p". Can you please upload it in the drive
File "/home/ec2-user/SageMaker/3M/denseeval3m.py", line 82, in
loss, split_predictions, lang_stats = eval_utils.eval_split(model, crit,
loader, vars(opt))
File "/home/ec2-user/SageMaker/3M/deneval_utils3m.py", line 111, in
eval_split
init_scorer('person-'+split+'-words')
File "/home/ec2-user/SageMaker/3M/misc/rewards.py", line 25, in init_scorer
CiderD_scorer = CiderD_scorer or CiderD(df=cached_tokens)
File "/home/ec2-user/SageMaker/3M/cider/pyciderevalcap/ciderD/ciderD.py",
line 28, in init
self.cider_scorer = CiderScorer(n=self._n, df_mode=self._df)
File
"/home/ec2-user/SageMaker/3M/cider/pyciderevalcap/ciderD/ciderD_scorer.py",
line 80, in init
pkl_file = cPickle.load(open(os.path.join('data', df_mode + '.p'),'rb'),
**(dict(encoding='latin1') if six.PY3 else {}))
FileNotFoundError: [Errno 2] No such file or directory:
'data/person-test-words.p'
—
Reply to this email directly, view it on GitHub
https://github.com/cici-ai-club/3M/issues/3#issuecomment-1493280099, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AI5ABMK65YNKQJYEPXHZXZTW7FCJJANCNFSM6AAAAAAVXQ7ETU
.
You are receiving this because you commented.Message ID:
@.***>

Hey Shreyas,
I think if you used different feature set, you need to retrain the model
for generation following the training steps. Otherwise, the trained model
would be confused with the input.
Chengxi
On Sun, Apr 9, 2023, 7:59 PM Shreyas SK @.***> wrote:

Extracted Features is about 80 GB. It's too difficult to upload it. You
can extract those features yourself easily.
You can take help from the below link to extract features. Just replace
the model tag
https://huggingface.co/docs/timm/main/en/feature_extraction
—
Reply to this email directly, view it on GitHub
https://github.com/cici-ai-club/3M/issues/3#issuecomment-1501327952, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AI5ABMNQMVAX3WLOKUI7LOTXANZSTANCNFSM6AAAAAAVXQ7ETU
.
You are receiving this because you commented.Message ID:
@.***>

Hey Chengxi,
I have evaluated the best model with test split. Below are the results
{'Bleu_1': 0.42620738153029025, 'Bleu_2': 0.20458454245542831, 'Bleu_3': 0.11215662186393982, 'Bleu_4': 0.0657656883734098, 'METEOR': 0.11409083638519023, 'ROUGE_L': 0.2693195972647437, 'CIDEr': 0.09645846960478273, 'SPICE': 0.03508444086667843, 'bad_count_rate': 0.0006011421701232341}
The metrics above are not matching with the ones provided in the paper. Can you please let me know if i need to tune any parameter to achieve the same results as in paper?

Hey Shreyas,
The hyperparamter should be in Readme. Did you follow the same training
process I suggested?
On Wed, Apr 12, 2023, 9:38 PM Shreyas SK @.***> wrote:

Hey Chengxi,
I have evaluated the best model with test split. Below are the results
{'Bleu_1': 0.42620738153029025, 'Bleu_2': 0.20458454245542831, 'Bleu_3':
0.11215662186393982, 'Bleu_4': 0.0657656883734098, 'METEOR':
0.11409083638519023, 'ROUGE_L': 0.2693195972647437, 'CIDEr':
0.09645846960478273, 'SPICE': 0.03508444086667843, 'bad_count_rate':
0.0006011421701232341}
The metrics above are not matching with the ones provided in the paper.
Can you please let me know if i need to tune any parameter to achieve the
same results as in paper?
—
Reply to this email directly, view it on GitHub
https://github.com/cici-ai-club/3M/issues/3#issuecomment-1506495578, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AI5ABMKX2PQYQTC7AHBHNLLXA6UQLANCNFSM6AAAAAAVXQ7ETU
.
You are receiving this because you commented.Message ID:
@.***>

Very small batch size would result very different training results with
paper. With my training I would need 30GiB of GPU memory. Suggestions are
go cloud training or turn of GUI
On Thu, Apr 13, 2023, 6:58 AM Nischal Newar @.***>
wrote:

Hey,
I need help with the Memory issue. The current batch size I am using is 2
and going to 1 is creating an issue. Do you have any suggestions?
"torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 64.00
MiB (GPU 0; 8.00 GiB total capacity; 7.20 GiB already allocated; 0 bytes
free; 7.23 GiB reserved in total by PyTorch) If reserved memory is >>
allocated memory try setting max_split_size_mb to avoid fragmentation. See
documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF"
—
Reply to this email directly, view it on GitHub
https://github.com/cici-ai-club/3M/issues/3#issuecomment-1507294373, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AI5ABMKCXPKYZ6HVJZYPTDTXBAWB3ANCNFSM6AAAAAAVXQ7ETU
.
You are receiving this because you commented.Message ID:
@.***>

Hey Chengxi,
Do you have the img_caption.json corresponding to flickr10K data (result of dense_cap) ?

Hi Chengxi,
I have used the best model weights provided in the repo and evaluated it based on the command provided in readme

Is your image Resnext features the same as mine?
I am not sure where your side is different from mine.
Chengxi
On Fri, Apr 14, 2023, 7:45 PM Shreyas SK @.***> wrote:

Hi Chengxi,
I have used the best model weights provided in the repo and evaluated it
based on the command provided in readme
—
Reply to this email directly, view it on GitHub
https://github.com/cici-ai-club/3M/issues/3#issuecomment-1509547634, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AI5ABMPWG5JAAUUC7BEYWDLXBIYY3ANCNFSM6AAAAAAVXQ7ETU
.
You are receiving this because you commented.Message ID:
@.***>

I have to check later 1 week later after my current vacation. Should have
before, not sure lost access or not. You can always use dense cap github to
generate.
On Fri, Apr 14, 2023, 4:35 PM mpremashish @.***> wrote:

Hey Chengxi,
Do you have the img_caption.json corresponding to flickr10K data (result
of dense_cap) ?
—
Reply to this email directly, view it on GitHub
https://github.com/cici-ai-club/3M/issues/3#issuecomment-1509473421, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AI5ABMMR5KEUQUVKSIOMGGDXBICPFANCNFSM6AAAAAAVXQ7ETU
.
You are receiving this because you commented.Message ID:
@.***>

Yes, I could not download the features from ParlAI but i took help from the below scripts in ParlAI to generate features.
https://github.com/facebookresearch/ParlAI/blob/main/parlai/core/image_featurizers.py
Mean pooled features - 'resnext101_32x48d_wsl': ['resnext101_32x48d_wsl', -1]
Spatial features - 'resnext101_32x48d_wsl_spatial': ['resnext101_32x48d_wsl', -2]
Let me know if these are the same as yours

Hey Shreyas,
I know the potential issues. The features I get from ParAI is 2019. At
2022, I used the same api from  and generate the same features under the
same hash, but the features are slightly different.. here I meant slightly
different is most of the features in most dimensions are the same but some
cells are not. I have emailed the author and he doesn't know why this could
happen. So I kept used the older version features. I am guessing is becasue
pytorch improving causing float accuracy changed. This could cause the
neural network resulting different sentences due to training features are
all slightly different too. Things I could do is I can try to find the
testing features I got from 2019. Then you can test on the features I got.
Or if you want, you can first examine whether the sentence from your test
set makes sense or not. This would explain whether there is any input
issues or from the issue I reported above.
Another thing you can do is go ahead retraining using the 3M under new
features and see what scores would happen there.
On Sat, Apr 15, 2023, 8:26 PM Shreyas SK @.***> wrote:

Yes, I could not download the features from ParlAI but i took help from
the below scripts in ParlAI to generate features.
https://github.com/facebookresearch/ParlAI/blob/main/parlai/core/image_featurizers.py
Mean pooled features - 'resnext101_32x48d_wsl': ['resnext101_32x48d_wsl',
-1]
Spatial features - 'resnext101_32x48d_wsl_spatial':
['resnext101_32x48d_wsl', -2]
Let me know if these are the same as yours
—
Reply to this email directly, view it on GitHub
https://github.com/cici-ai-club/3M/issues/3#issuecomment-1510108601, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AI5ABMOH6HQ3HTQZJM2GQ5LXBOGKDANCNFSM6AAAAAAVXQ7ETU
.
You are receiving this because you commented.Message ID:
@.***>

Thanks a lot for pointing out the issue. Please share with me the test features you've got. And I have started to train with the features I have with g5.12xlarge Sagemaker instance having 4 24 GB GPUs but it takes very long time to complete 1 epoch (~2 hours). I was not able to use Distributed Data Parallel to speed up the training because h5 files are not picklable.


Add fzf file selection via pyfzf

This implements the workflow of https://github.com/paul-gauthier/aider/issues/492 using pyfzf. What it doesn't do it yet is respect .aiderignore entries, but I first wanted to check if there's general interest in implementing something along those lines.

I know fzf is a popular tool, but I'm not likely to add it as a dependency for aider. I work very hard to make sure it is easy to install aider, avoiding extra platform specific install steps if possible.
Also, it appears that you could easily use a shell script wrapper to achieve the functionality in this PR, without needing to modify aider at all.

My bad, I repressed the fact that fzf is still required to be preinstalled. Definitely shouldn't be a prerequisite for running aider.

You could perhaps add a python setup.py option, eg pip install aider[fzf] for those who want it?

You could perhaps add a python setup.py option, eg pip install aider[fzf] for those who want it?

That would require deterministic detection and interaction of various package manager + operating system flavors and their respective idiosyncrasies, besides handling the usually required privilege escalation (sudo) for package installs. It would probably only end in tears in the long run

I guess middle ground could be a conditional check for an existing fzf installation on aider program start and only then properly exposing the "--fzf" flag.

Not really if you use pyfzf, and you let the user ensure on his own (he knows what he is doing) that the fzf binary is installed

eg, if the user knows he has fzf installed, and then chooses to use pip install aider[fzf] it installs pyfzf


Version mismatch 1.77 vs 1.78

Visual Studio error:
LINK : fatal error LNK1104: cannot open file 'libboost_locale-vc142-mt-s-x64-1_77.lib'
In fact: there is no libboost_locale-vc142-mt-s-x64-1_77.lib, but libboost_locale-vc142-mt-s-x64-1_78.lib exists
Probably https://github.com/boostorg/config/blob/develop/include/boost/version.hpp should be upgraded to 1.78

https://github.com/boostorg/config/pull/395


New command for adding a linked server

Type of Change

[ ] Bug fix (non-breaking change, fixes # )
[x] New feature (non-breaking change, adds functionality, fixes #6506 )
[ ] Breaking change (effects multiple commands or functionality, fixes # )
[x] Ran manual Pester test and has passed (`.\tests\manual.pester.ps1)
[ ] Adding code coverage to existing functionality
[x] Pester test is included
[ ] If new file reference added for test, has is been added to github.com/sqlcollaborative/appveyor-lab ?
[ ] Nunit test is included
[x] Documentation
[ ] Build system

Purpose

Basic command to add a new linked server.
Commands to test

See the integration tests.

So this will be part of #6506?

Hi @andreasjordan, I had not seen that issue, but yes I will update the description of this PR and the other one I just added for removing a linked server so that they both reference 6506.
Thanks,
Adam

There is also this one: #6196

When I tried the "set" workflow SMO displayed an error message indicating that the linked server has to be dropped and recreated.

Ok, then maybe you can add the messages to the feature request and close it.

Looks nice! Any chance you can add a LoginCredential or something similarly named and allow them to create a Linked Server login?

If it's too much work, we can add it later.

@potatoqualitee, would it be ok to accept the current scope of this PR as a phase 1? I could come back to the login piece at a later date as a phase 2. I would want to proceed very carefully on that part because of the need for secure credential handling.
@andreasjordan, I added the comment to #6196, but I don't have permission to close issues.

Thank you @potatoqualitee and @andreasjordan. I've incorporated the feedback mentioned by @andreasjordan.

Approved both pull request.

Fantastic 💯 !


Error after doing make update.

Hi, recent commits seem to break make update in a harmless way :)
 ❯ make update                                                                                (937ms)
Looking for outdated packages...
1 packages will be updated:

+ osc   20171114.2207  -> 20171114.2213

y
Updating osc
  DONE
Finished!
Reloading...
No such server: server
make: *** [Makefile:24: update] Error 255
Proceed? (y or n)

seeing the same thing as well.

Just pushed a fix for this to develop. I'll merge it into master this weekend.

It works fine now. Thanks!

It seems make update doesn't recompile packages. I've encountered a magit bug due to this.

and make install results in
Installing ox-pandoc
  FATAL ERROR: (error) Package does not untar cleanly into directory org-20171116/
Installing ox-hugo
  FATAL ERROR: (error) Package does not untar cleanly into directory org-20171116/
Installing ox-reveal
  FATAL ERROR: (error) Package does not untar cleanly into directory org-20171116/
Installing ob-translate
  FATAL ERROR: (error) Package does not untar cleanly into directory org-20171116/
Installing ob-rust
  FATAL ERROR: (error) Package does not untar cleanly into directory org-20171116/
Installing ob-redis
  FATAL ERROR: (error) Package does not untar cleanly into directory org-20171116/
Installing ob-mongo
  FATAL ERROR: (error) Package does not untar cleanly into directory org-20171116/
Installing flycheck-rust
  FATAL ERROR: (error) Package does not untar cleanly into directory seq-2.20/
Installing company-auctex
  FATAL ERROR: (error) Package does not untar cleanly into directory auctex-11.91.0/
Installing auctex
  FATAL ERROR: (error) Package does not untar cleanly into directory auctex-11.91.0/
Installing cider
  FATAL ERROR: (error) Package does not untar cleanly into directory seq-2.20/
Proceed? (y or n)

Does doom provide a way to customize package-archives?

You can modify package-archives in ~/.emacs.d/modules/private/$USER/init.el, and it should affect non-core packages.

It seems make update doesn't recompile packages

It should delete old packages and install/byte-compile new ones, so recompilation should be unnecessary. If you are using multiple computers, byte-compilated code on one computer may not necessarily work on another.
In any case, I've added a new make command: make compile-elpa for recompiling packages. Let me know if that resolves your issue.

and make install results in ...

This is often a sign that a package url in package-archives is incorrect or down, or a recent package-refresh downloaded faulty data. Try DEBUG=1 make install, which will refresh the archives and, hopefully, offer more information.

The fix for the original issue is now in master, so I'll consider this resolved.


Docs: Improve remove telnet password wiki

I might be dumb but it took me a bit until I noticed the username in reset password cmd, otherwise I wasn't able to login because I did not know the username.
I would suggest to change this sentence Use password to enter Telnet and remove Telnet password: to Use the obtained password to enter Telnet (username: admin), and remove Telnet password:

Fixed

Fixed


Fuzz test calculate_* trades against solidity

There are limited tests for rust calculate_* functions against what's implemented in solidity:

Open long/short doesn't fuzz against solidity.
Close long/short only fuzzes the underlying calculate_close_long_flat_plus_curve and calculate_close_short_flat_plus_curve against the calculate_close_* from hyperdrive math. However, these functions do not take fees or negative interest checks into account (both on the solidity and rust side).

Ideally, we would fuzz these trades against the public interface of hyperdrive.

Duplicate of #861; closing


[BYOC][ETHOSN] Add support for quantized convolution

This PR adds support for quantized convolution for the Ethos-N backend. This includes mapping it via a composite function and all the necessary methods to convert from Relay to the APIs in Support Library.
Co-authored-by: Leo Blonk<EMAIL_ADDRESS>Co-authored-by: Tristan O'Connor<EMAIL_ADDRESS>

cc @masahi @comaniac @zhiics @Leo-arm

Thanks @mbaret @comaniac


Print is overextending

Hi, I'm printing spine labels, and it's having the issue where it prints out one correct label and then overextends a few labels after that. It seems like it thinks it's a full 8.5x11 page rather than the small label it's printing out. I also don't know if the fact that the label printer is an old Dot Matrix printer affects this problem.

Any update for this? Having exact same issue after updating to Windows 11

Closed due to lack of response.


FreeSurfer and Python Interaction

Hello,
I am currently working my way through the anatomy.py script (the def process_subject_anat function) using the most recent version of MNE (0.18) and Spyder (Python 3.7). I ran into an error when running the script:
File "", line 94, in
parallel(run_func(subject_id) for subject_id in range(1, 20))
File "/Users/gellr/anaconda3/lib/python3.7/site-packages/sklearn/externals/joblib/parallel.py", line 930, in call
self.retrieve()
File "/Users/gellr/anaconda3/lib/python3.7/site-packages/sklearn/externals/joblib/parallel.py", line 833, in retrieve
self._output.extend(job.get(timeout=self.timeout))
File "/Users/gellr/anaconda3/lib/python3.7/site-packages/sklearn/externals/joblib/_parallel_backends.py", line 521, in wrap_future_result
return future.result(timeout=timeout)
File "/Users/gellr/anaconda3/lib/python3.7/concurrent/futures/_base.py", line 432, in result
return self.__get_result()
File "/Users/gellr/anaconda3/lib/python3.7/concurrent/futures/_base.py", line 384, in __get_result
raise self._exception
RuntimeError: I cannot find freesurfer. The FREESURFER_HOME environment variable is not set.
The FreeSurfer environment is set in my terminal (I can run recon from it). Any ideas on how to fix this?
Best,
Jason

I also get this error:
FileNotFoundError: [Errno 2] No such file or directory: 'recon-all': 'recon-all'

you need so install and setup freesurfer before running this.
recon-all is a freesurfer command line tool.

FreeSurfer is installed in my computer—I am able to recon files from it. Oddly, when I open Anaconda directly from the terminal it recognizes FreeSurfer.
Get Outlook for iOShttps://aka.ms/o0ukef

From: Alexandre Gramfort<EMAIL_ADDRESS>Sent: Thursday, April 18, 2019 2:33 AM
To: mne-tools/mne-python
Cc: Geller, Jason; Author
Subject: [External] Re: [mne-tools/mne-python] FreeSurfer and Python Interaction (#6168)
you need so install and setup freesurfer before running this.
recon-all is a freesurfer command line tool.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/mne-tools/mne-python/issues/6168#issuecomment-484389627, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AEMTQEBVKAAAEIVZM7O5V3DPRAP5LANCNFSM4HGX73SA.

if you use spyder you need to source freesurfer before starting it from a
terminal.
HTH

you need so install and setup freesurfer before running this. recon-all is a freesurfer command line tool.

sorry, can I ask a question? If I installed the freesurfer, can I run the cortex.segment.init_subject("S" + user, anat_path) without error_msg? Or I have to use freesurfer to do this command?(can python call the freesurfer outside the freesurfer?)


Resource trackers might duplicate

LOW Priority, but if I refresh using F5, on some actors, the resource trackers duplicate:

It doesn't happen to all actors... and the actor it is currently happening on is brand new.   I just created him and imported the XML file.
Note certain if this is an indicator of something else... of just a bad actor.

It als also happened when I created a new resource tracker, it instantly duplicated.

Expanding on thiis, I was running a game last night and one of the playuers has a custom resouorce tracker.  Neither he nor I as GM could add or subtract to it or even change the base value.  This was resource tracker 0.  Then I realised that resource tracker 4 had sprung into existence and was actually changing in relation to anything attempted on resource tracker 0 (which sort of gave us a work around).

More on this.  I had a token with borked resource tracking showing on the character sheet.  So I deleted the actor and the token and recreated and now there are no additional resource trackers available in the Full GCS, the Editor, the Combat, or the Tabbed.  Just the HP and FP.  Other tokens that still had additional resource trackers still have them, but new ones can't add them.  Going to post this as a new issue, too.

I think all these issues are fixed.


fixed afterPaste to combine new and old values

Fixes #552
When pasting values into a populated array field, the new values (whether one or many) will now be concatenated onto the old values.

Thanks for the PR !!!


Upgrade to terraform 0.14

This should probably be considered a breaking change.

@tmknom do you have any feedback on this PR? :slightly_smiling_face:

@tmknom do you have any feedback on this PR? :slightly_smiling_face:

This PR does no longer make sense and the project doesn't seem to be maintained.


Add the ability to start the game before everyone submitted their words/boot players that haven't submitted their words

We just tried playing this in an online team meeting, and couldn't start the game because a couple of people initially joined but then dropped off the call without submitting words.
Suggestions:

Allow host to start the game with the players that have submitted their words
Allow host to boot players that haven't submitted their words

Thanks!

Hey @oryz, I happened to make a different version of this game (mostly because I didn't know it by the name "fishbowl" and only found this one after sharing my own version) - but it has a few different features and if you're looking for something that lets the host boot players, my version does happen to have that feature.
You can also boot players mid-game, have them rejoin later, or even give their "place" to someone else depending on the need.
You can play at https://playthenakedgame.com/

Thanks @tylercal will check it out!


Sdc 1871

Hi, Streamsets Team.
I resolved SDC-1871.
I added Use Custom Query configuration into JDBC Producer.
If check "Use Custom Query" then SQL Query box occur in JDBC Tab.

If check "Use Custom Query" then Internally generates the JdbcCustomQueryRecordWriter and that execute using user's query.
I tried to create similar to the structure of the DataCollector jdbc-lib.
Could you examine my PR and merge into master branch?
I will wait for your reply.
Thank you.

I would also like this functionality to be merged into the master branch.

We've made several changes recently, so the patch will sadly have to be rebased. Otherwise I'm happy to finish the review and get it in :)

I wonder if you're still interested in pushing the patch through @springloops ?

We haven't heard back in a while, so I'll close the pull request, for now, to clean up the queue. However, if you'll get to it again, please do not hesitate and submit a new pull request @danfranks !


Release new version that works with lua-cliargs >=3.0

Hi,
I am the guy that tries to port busted to OpenBSD. The sad thing is that the current release of busted (v2.0.rc11-0) does not yet have the fixes in place to support lua-cliargs >= 3.0. Could you please a new version with those fixes in place? It would spare some manual patching in the port.
Thanks.

It is also requested here #498.

Any chances for an rc12 release?

Released v2.0.rc12-1.


Not building for android

jni build succesfully, but .so files - not(
I run mvn install -P android with no luck
Error in logs:
checking whether the C compiler works... no
[INFO] configure: error: in /Users/recoilme/asp/lmdbjni/lmdbjni-android/target/native-build': [INFO] configure: error: C compiler cannot create executables [INFO] Seeconfig.log' for more details
In config.log  - wrong directory name

android-ndk-r10e/toolchains/arm-linux-androideabi-4.9/prebuilt/linux-x86_64
linux-x86_64 is missing in ndk.
I try rename darwin-x86_64 to linux-x86_64 with no luck. Now errors command line options not supported and so on.

May you provide some information how to build for android?

I built it on Linux last time. You may need to adjust the android pom with the correct --host option. Also you need to set the NDK path variable.
There is also a release in maven central, if that works for you.
<dependency>
    <groupId>org.deephacks.lmdbjni</groupId>
    <artifactId>lmdbjni-android</artifactId>
    <version>0.4.0</version>
</dependency>

Thx for the answer. So i add in gradle maven dependency:
compile group: 'org.deephacks.lmdbjni', name: 'lmdbjni-android', version: '0.4.0'
And project build well, but i have error native library missing at run:
Could not load library. Reasons: [...,nativeLibraryDirectories=[/data/app/ru.test.test-2/lib/arm, /vendor/lib, /system/lib]]] couldn't find "liblmdbjni-1-0.0.so",...couldn't find "liblmdbjni.so"]
May you provide prebuild version liblmdbjni.so and may be somethink like  libmdb.so will needed too?

I try reproduce step by step how i try to build:
git clone https://github.com/deephacks/lmdbjni.git
cd lmdbjni/
mvn package (success)
cd lmdbjni-android/
export NDK=/Users/recoilme/android-ndk-r10e
mvn install -P android
-- configure: error: C compiler cannot create executables
See `config.log' for more details
config.log:
target='x86_64-unknown-linux-gnu'
target_alias=''
target_cpu='x86_64'
target_os='linux-gnu'
target_vendor='unknown'

Ops, i extract *so and put manualy and now all works good, thank you
I create repo with builded lmdb jni  - for simple test lmdb vs leveldb vs filesystem here:
[https://github.com/recoilme/testLevelDb]
Just put & get some byte array to db 50 times in one circle:
for (int i = 0; i < n; i++) {
lmdb.put((""+i).getBytes(), byteArray);
byte[] bytes = lmdb.get((""+i).getBytes());
}
It's work, and better then Level db, but perfomance not so good as i expected(
File (write, read)*50 : 1620ms
LevelDB (get, put)*50 : 6723ms
Lmdb (get, put)*50 : 3919ms
I expect what its must work like memory, but it work like filesystem^^
Please, may you give me right direction how tune speed on?

There are a number of thing you can do to increase write speed.

If keys are sorted you can use the APPEND mode. Be careful, if keys are unsorted you can corrupt the database.
Don't fsync metapage after commit using NOMETASYNC.
Use asynchronous msync MAPASYNC.
Don't fsync after commit using NOSYNC.

All of these options are available in the Constants class.

Thank you, Kristoffer
With this options speeds is more close to file system and, sometime, faster >>
File open, (write, read)*5 : 126ms
LevelDB (get, put)*5 : 875ms
Lmdb (put, get)*5 : 95ms

And one more question, pls: what do you think about try build lmdb specialy for android with this commit:
https://github.com/recoilme/LMDB_0.9.15_32x/commit/6fc390dec8580aa5f49f9cf704870ca247f5682d
If i understand right, with this commit direct buffer must work on android, or all not so easy?
Right now i dont see some effective and simple key/value storage for byte arrays with good speed and small overhead, and lmdb looks very promising, but we need more speed on mobile devices. I want try this, but have no luck with build from source for android...

It would be very nice to have direct buffer support on Android. We tried to get it working before but failed, see https://github.com/deephacks/lmdbjni/issues/21. I must admit that neither my android nor c skills is good enough to make a fair judgement.
Have you tried direct buffers with this commit?

Sorry^ i am so lame and dont may build from source (i extract *so from jar from maven and put manualy) but i will be happy to do some tests if you may try build with this commit and give me *so

The clone you're referring to looks like the vl32 branch on LMDB?
https://github.com/LMDB/lmdb/tree/vl32

Yes

I built this from latest https://github.com/LMDB/lmdb/tree/vl32 using the following agcc script.
#!/bin/bash
$NDK/android-ndk-r10e/toolchains/arm-linux-androideabi-4.9/prebuilt/linux-x86_64/bin/arm-linux-androideabi-gcc --sysroot=$NDK/android-ndk-r10e/platforms/android-19/arch-arm -DMDB_DSYNC=O_SYNC $@

make CC="./agcc"

https://dl.dropboxusercontent.com/u/39196712/liblmdb.so
Let me know how it goes.

Kristoffer,
but how test it without jni?

You can replace the so file in lmdbjni-android-0.4.0. jar.

Sorry, i try it, but lmdbjni-android contains only solid liblmdbjni.so (1.2Mb)

Sorry, of course you need the proper jar built. Silly me.
https://dl.dropboxusercontent.com/u/39196712/lmdbjni-android-0.4.3-SNAPSHOT.jar

I am not sure what all do right
At first - i am replace *so and add this code in test:
    //add some array
    long t0 = System.currentTimeMillis();
    Transaction tx = env.createWriteTransaction();
    for (int i = 0; i < n; i++) {
        lmdb.put(tx, ("" + i).getBytes(), byteArray);
        byte[] bytes = lmdb.get(tx,("" + i).getBytes());
    }
    tx.commit();
    String s = "Lmdb (put, get)*" + n + " : " + (System.currentTimeMillis() - t0) + "ms\n";

    textView.append(s);
    Log.w(TAG,s);
    // Buffer cursor
    tx = env.createReadTransaction();
    try {
        BufferCursor cursor = lmdb.bufferCursor(tx);
        cursor.first();
        while(cursor.next()) {
            // read a position in buffer
            cursor.keyByte(0);
            cursor.valByte(0);
        }
    }
    catch (Exception e) {
        e.printStackTrace();
    }

And programm fail with sigsegv:
08-11 11:49:05.997    4369-4369/ru.test.test A/libc﹕ Fatal signal 11 (SIGSEGV), code 1, fault addr 0x10 in tid 4369 (ru.test.test)
08-11 11:49:06.099      191-191/?  I/DEBUG﹕ Build fingerprint: 'google/hammerhead/hammerhead:5.1/LMY47I/1767468:user/release-keys'
08-11 11:49:06.099      191-191/? I/DEBUG﹕ Revision: '11'
08-11 11:49:06.099      191-191/? I/DEBUG﹕ ABI: 'arm'
08-11 11:49:06.099      191-191/? I/DEBUG﹕ pid: 4369, tid: 4369, name: ru.test.test  >>> ru.test.test <<<
08-11 11:49:06.099      191-191/? I/DEBUG﹕ signal 11 (SIGSEGV), code 1 (SEGV_MAPERR), fault addr 0x10
08-11 11:49:06.106      191-191/? I/DEBUG﹕ r0 00000013  r1 95483fac  r2 0013507b  r3 00000009
08-11 11:49:06.106      191-191/? I/DEBUG﹕ r4 00000010  r5 b4aff560  r6 00000010  r7 00000010
08-11 11:49:06.107      191-191/? I/DEBUG﹕ r8 00000000  r9 b4827800  sl 00000000  fp 12c5f460
08-11 11:49:06.107      191-191/? I/DEBUG﹕ ip 95483000  sp bea79e80  lr b3586180  pc b35839b0  cpsr 200b0010
08-11 11:49:06.107      191-191/? I/DEBUG﹕ backtrace:
08-11 11:49:06.107      191-191/? I/DEBUG﹕ #00 pc 000139b0  /data/app/ru.test.test-2/lib/arm/liblmdbjni.so (mdb_node_read+92)
08-11 11:49:06.107      191-191/? I/DEBUG﹕ #01 pc 0001617c  /data/app/ru.test.test-2/lib/arm/liblmdbjni.so (mdb_cursor_first+276)
08-11 11:49:06.107      191-191/? I/DEBUG﹕ #02 pc 000150d0  /data/app/ru.test.test-2/lib/arm/liblmdbjni.so (mdb_cursor_get+612)
08-11 11:49:06.107      191-191/? I/DEBUG﹕ #03 pc 000d0b8b  /data/dalvik-cache/arm/data@app@ru.test.test-2<EMAIL_ADDRESS>

More detail message:
this command:lmdb.bufferCursor(env.createReadTransaction()).first()
org.fusesource.lmdbjni.LMDBException: MDB_BAD_RSLOT: Invalid reuse of reader locktable slot

Yes, i'm afraid that BufferCursor will not work without taking 32-bit addresses into account.
I don't have time to spend on this right now. But if you want to take a stab at it, read up on #21 and try something similar. If you get a prototype working i'll be happy to implement the rest.

Whats sad but not critical. I dont know C( Feel free to close this issue..
Last question: i am right understand what jnilmdb will work only on android 19+?

There is nothing in lmdbjni that enforce a particular android version. I would expect the NDK to be backward compatible.

Ok, closing.


how to active the color of tab when on back pressed?!

when on back pressed, the color of tab does not change.how can I handle it?

Did you find the answer to this problem?? I am having the same problem


Prevent message packages from crates.io to be included during the build

As a side effect of https://github.com/ros2-rust/ros2_rust/pull/392, a set of message packages are now published on crates.io (see https://crates.io/crates/builtin_interfaces for example), although they've been yanked, this exposes an issue in our build system that anyone could register a crate named like a message package and potentially cause issues.
I've thought of something like this:

rosidl_generator_rs stays the same
a new base ros2_messages crate
the ros2_messages crate can accept a list of features, each feature is the name of a message package
the ros2_messages crate uses ament_rs to find the paths of the generated Rust files for each message package and uses include!() on those files
downstream packages can access the messages via ros2_messages::buildin_interfaces, ros2_messages::std_msgs, etc.

I'm going to work on this urgently as the current situation needs to be fixed before it causes any breakage.
@jhdcs @maspe36 @mxgrey @luca-della-vedova thought?

This is an interesting idea. But it's such an unconventional use of crates.io and cargo that I'd need to think very carefully about potentially bad side effects.
Would we also publish a ros2_messages crate to crates.io?

If so, what would it include? I'm not even sure how include!() works for published packages.
If not, what stops someone from publishing one and breaking this new approach?

@mxgrey ros2_messages would be published, that'd be our way of gatekeeping anyone from abusing crates.io to inject any dependencies. I'd argue that our combination depending on message packages whose version is "*" and using colcon is far more unconventional.

If so, what would it include? I'm not even sure how include!() works for published packages.

It'd have code to read features from Cargo.toml and call include!(...) the appropriate messages. We already publish rclrs to crates.io and it contains a call to include!(...)

The problem is that no matter what, the interaction between colcon and cargo has always forced us to make unconventional approaches. They're both opinionated systems, and it feels like their opinions often don't match. @esteve already mentioned the black magic we're currently doing in the post above.
Personally, I feel like this fix is the right way to go. Even if it only turns out to be short-term, it gets people building again. Once it's out we all can try and brainstorm if a better solution exists.

Also, a nice bonus of this solution is that I think we'd no longer need to vendorize messages.

I like avoiding needing to vendorize messages. That should hopefully make things a bit easier on the end user as well...

Looks like this solution won't work, a dependency needs to explicitly declare its features, so a downstream can't pass arbitrary features to a dependency. Does anyone know how to pass arbitrary metadata to a dependency? Alternatively, I think we could pass compiler flags to rustc, that could be read by ros2_messages and therefore call include!(..) approrpriately for each message package.

I'm not seeing anything on passing arbitrary metadata to a dependency, but I'll try to keep looking...

I don't suppose the pkg-config crate would be useful for this?
https://crates.io/crates/pkg-config

I don't suppose the pkg-config crate would be useful for this?

Nice find! pkg-config might not be portable to platforms other than Unix, but I think it's a really good lead. Thanks!

I'm leaning towards adding this functionality to a build script. Or perhaps to the cargo ament plugin, which could read the dependencies from package.xml and therefore declare the messages packages.

cargo ament build accepts a metadata.ros section (see https://github.com/ros2-rust/cargo-ament-build), which we can extend to add a messages field and declare the messages there. Eventually we could make it more magic and do that automatically, though.

So I'm trying to understand our message pipeline thoroughly. I'm taking a look at colcon-ros-cargo currently. This is the colcon plugin that will ultimately call cargo build for packages that have a Cargo.toml and a package.xml.
One of the main jobs for this plugin, is to create this .cargo/config.toml file in whatever folder you're calling colcon build. This file, "patches" our dependencies, or in other words, overrides dependencies with other source file copies (1, 2). But its not just any dependency patch, its actually a patch to the version we would pull from crates.io.
An example snippet from my .cargo/config.toml
[patch.crates-io.rcl_interfaces]
path = "<workspace>/install/rcl_interfaces/share/rcl_interfaces/rust"

As I understand it, the intention here is to override any version of rcl_interfaces I may pull from crates.io for any colcon-ros-cargo (and maybe colcon-cargo as well?) ROS package, and use the version at the given path (This is a full crate, it has source files and a Cargo.toml).
<workspace>/install/rcl_interfaces/share/rcl_interfaces/rust
├── build.rs -> <workspace>/build/rcl_interfaces/rosidl_generator_rs/rcl_interfaces/rust/build.rs
├── Cargo.toml -> <workspace>/build/rcl_interfaces/rosidl_generator_rs/rcl_interfaces/rust/Cargo.toml
└── src
    ├── lib.rs -> <workspace>/build/rcl_interfaces/rosidl_generator_rs/rcl_interfaces/rust/src/lib.rs
    ├── msg.rs -> <workspace>/build/rcl_interfaces/rosidl_generator_rs/rcl_interfaces/rust/src/msg.rs
    └── srv.rs -> <workspace>/build/rcl_interfaces/rosidl_generator_rs/rcl_interfaces/rust/src/srv.rs

If my understanding is correct, then is this really a problem? I was unable to verify breakage on my end as they were already yanked before then. If we did see breakage, then it seems like there could be a bug in here


Deploy the Fiori App to Cloud Foundry

Tutorials: https://developers.sap.com/tutorials/sapui5-fiori-cf-deploy.html
In step 3 it might be that the "cf html-5 plugin" has to be installed. In the Web IDE this is already done, but not on our local machines. I have done that installation via the installation instructions on page https://github.com/SAP/cf-html5-apps-repo-cli-plugin
Maybe a hint and a link would be helpful...
Cheers,
Dominik

Good catch as well. I fixed this and the new version should be live soon.
Thanks.


Markdown viewer documentation

Please use the form below, leaving the prefilled data to help us. Thank you.
Page link: widgets
Document link: _index.md
My Issue/Suggestion
Today I was redirected here from the Markdown viewer component on marketplace (https://marketplace.mendix.com/link/component/230248). However it does not seem to be in the list, is this known? cc @takumagott
Context: just exploration and curiosity (we already use it in one of our assets) based on the tech talk presentation. But my main goal now was to find a complete overview of what markups shorthands are able to be rendered by the widget and/or, if the answer is "everything that is in the markdown standard" a link to such a reference documentation.

Hi @tswarmerdam-mx ,
I'll be ensuring a docs page gets published for this widget.
Thanks for the feedback,
Connor


Odd behavior of file.statSync() when file is a symlink

Consider this code:
(assume real == a string path to a symlink on a Mac)
  var file = new File(real);
  print(file);
  var stat = file.statSync();
  print(stat);  // <===== here's the bug. it says FILE, but I would imagine it to say LINK
  var isLink = stat.type == FileSystemEntityType.LINK;
  print("this should be true: $isLink");  // <=== isLink is false
Expected: isLink is true

FWIW, in C, following symlinks is the normal behavior for stat.  There is traditionally a separate lstat function for operating on links.
Personally I'd prefer a followLinks named parameter on the existing FileSystemEntity.stat/statSync and FileStat.stat functions, but a separate FileStat.lstat function would be acceptable too if there are compatibility concerns.

On Windows we are currently not resolving symlinks. I'll fix that and update the docs as my first step.

Adding a followLinks named parameter isn't feasible because it would break any subclasses of FileSystemEntity (of which there are many). Likewise for IOOverrides.
I think that @jamesderlin 's proposal of having a lstat method is reasonable.
Any thoughts?

lstat might have to be an extension method, because it's a breaking change to add a new instance method to a widely used class.

@eernstg Making lstat an extension method would work but how would we add it to IOOverrides?

I don't know any details about IOOverrides, but taking a look at it I would expect that the lstat method would have to use a similar technique as the existing implementation of, say, statSync:
  static FileStat statSync(String path) {
    final IOOverrides? overrides = IOOverrides.current;
    if (overrides == null) {
      return _statSyncInternal(path);
    }
    return overrides.statSync(path);
  }

IOOverrides.current is accessible from the extension method, and overrides.lstatSync(path) should work from there as well, so it looks like there is nothing that prevents using the same technique in an extension method.

Let me take a step back - I don't understand why we can't add a new method to a widely used class. Is that because a subclass might already define the same method but, for example, with a different signature?
If that is the issue, then wouldn't the same issue exist when adding lstat to IOOverrides? Or would we also implement that as an extension method?

The typical problem with adding methods is if there is a derived class that implements the interface.  Adding a method to the interface would be a breaking change since all implementers would need to add the new method.
In this case, a notable implementation of dart:io's File class is the File class package:file.

It might be OK to implement lstat/lstatSync as new instance methods on class IOOverrides, because that class is intended to have subclasses (so extends IOOverrides is OK), but not other subtypes (so implements IOOverrides does not seem to be recommended, and also does not seem to be used anywhere that I could spot right now).


Release binaries should not be built using CGO

Right now they seem to be linked using CGO and result in dynamically linked binaries:
$ file fortigate-exporter.linux.amd64
fortigate-exporter.linux.amd64: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, Go BuildID=aC_NDJcH75wKecO7Svr3/siFCDbSCqhv7y72S7Mz7/wOdLiG5GObmgWQWsk5Vj/M1trWEvxBKJed0WeW5tI, not stripped
$ ldd fortigate-exporter.linux.amd64
        linux-vdso.so.1 (0x00007fffd2a3e000)
        libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f4f1919e000)
        libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f4f18fd0000)
        /lib64/ld-linux-x86-64.so.2 (0x00007f4f191db000)

Building with CGO_ENABLED=0 seems to work as far as I can see, so I will submit a PR for that.

:tada: This issue has been resolved in version 1.4.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


docs:  removed depreciated hacktober fest logo and added a new one (fixed #665)

Title of the Pull Request

[x] Have you renamed the PR Title in a meaningful way?

Related Issue
Closes: #665
Description
removed depreciated hacktober fest logo and added a new one
How Has This Been Tested? ⚙
tested the readme locally
Screenshots 📷

Type of change
What sort of changes have you made:

[x] Bug fix (non-breaking change which fixes an issue)

Checklist

[x] My code follows the code style of this project.
[x] I have followed the contribution guidelines
[x] I have performed a self-review of my own code.
[x] I have ensured my changes don't generate any new warnings or errors.
[x] I have updated the documentation (if necessary).
[x] I have resolved all merge conflicts.

@vishanurag  merge please


Bad loader rendering

Due to special styling of the README from https://github.com/webpack/less-loader/pull/119, the less-loader documentation rendering is rather unfortunate:

the badges are being displatyed as [![npm][npm]][npm-url] [![node][node]][node-url] [![deps][deps]][deps-url] [![tests][tests]][tests-url] [![coverage][cover]][cover-url] [![chat][chat]][chat-url]
the webpack logo seems unnecessary
due to the centered
/
 headings in the README.md, no anchors are inserted.

This should be addresses since similar modifications for other loaders are scheduled: https://github.com/webpack/webpack/issues/3195

Good point. This will probably not be easy to fix though, since the readme's are auto-generated :(. Do you have any suggestions how to tackle this?

In scripts/fetch_package_files.js, one could:

delete all lines until encountering
Install

replace any
 and
 with # (likewise for h2 and ##)


Add _WD_DispatchEvent

Pull request
Proposed changes
Provide UDF that facilitates creation and dispatch of events
Checklist
Put an x in the boxes that apply. If you're unsure about any of them, don't hesitate to ask. We are here to help!
This is simply a reminder of what we are going to look for before merging your code.

[x] I have read and noticed the CODE OF CONDUCT document
[x] I have read and noticed the CONTRIBUTING document
[ ] I have added necessary documentation or screenshots (if appropriate)

Types of changes
Please check x the type of change your PR introduces:

[ ] Bugfix (change which fixes an issue)
[ ] Feature (change which adds functionality)
[ ] Code style update (formatting, renaming)
[ ] Refactoring (functional, structural)
[ ] Documentation content changes
[ ] Other (please describe)

What is the current behavior?
There is no easy way to trigger events.
What is the new behavior?
New UDF uses Javascript to create and dispatch event to target element.
Additional context
Add any other context about the problem here.
System under test
Please complete the following information.

OS: [e.g. Windows 10]
OS Arch.: [e.g. X64]
Browser [e.g. firefox]
Browser version [e.g. 96.0.3]

Looks ok

README.md should be suplemented.

I plan to update both README and CHANGELOG via a separate PR that will encompass all recent changes


Investigate nightly build issues

investigate nightly build scripts & QE production build versus our dev build

Going to start taking a look at this and gathering what I can...

Nightly build issues are being investigated by @bthurber and the QE team. No need to involve UI Dev.

While we aren't reviewing the QE scripts directly, it may behove us to continue in sync w/ the appliance build scripts located here and find opportunities for logging v2v specific build configurations:
https://github.com/ManageIQ/manageiq-appliance-build
I've filed #422 , #423 , and #424 after discussing some further options yesterday around UI reliability. Beyond this, we will have to do some more environment specific investigations it sounds...


[Storage] Sanity testing for browser using the sample html files

We need to test the aka.ms download for the zip release.
@XiaoningLiu can provide the sample html files.

Yes. I have simple sanity test files and can provide.

Tested html files, react app, added new browser samples in the repo.
#Done


Global MailChimp Settings

Currently a MailChimp list ID (mailchimp_list_id: f2fab1dfd4) is set in the Drupal Third Part Opt-In -> General form: https://www.dosomething.org/admin/config/dosomething/opt_in.

This value is included in user_registration transactional message requests sent to Message Broker as a part of the activity": "user_register request payload:
"mailchimp_list_id": "f2fab1dfd4"

The form needs to be expanded to support mailchimp_list_id values for:

Global
US (United States)
BR (Brazil)
MX (Mexico)
CA (Canada)
UK (United Kingdom)

Perhaps support for the remaining affiliates should also be added:

ID (Indonesia)
etc.

Related:

https://github.com/DoSomething/phoenix/issues/4955

@DeeZone Do you also need me to add these new values into the MB payload or is that a separate issue?

@deadlybutter let's group them all with in general, and then have have subgroups within that for

Global
US
Mexico
Brazil

I'll make a separate future issue for Canada/UK because that's not within this first version of Global.
Let's also leave the Global, Mexico, and Brazil fields as unrequired for now (keep US ones required) and I'll make a separate issue for those to be required after we have values for them.


Remove FLUTTER_DEVICELAB_XCODE_PROVISIONING_CONFIG

The environment variable FLUTTER_DEVICELAB_XCODE_PROVISIONING_CONFIG is no longer needed after https://github.com/flutter/flutter/pull/43553/. The provisioning config can be provided by the following env vars instead:

FLUTTER_XCODE_CODE_SIGN_STYLE=Manual
FLUTTER_XCODE_DEVELOPMENT_TEAM=
FLUTTER_XCODE_PROVISIONING_PROFILE_SPECIFIER=

/cc @jmagman

Is issue to remove the code path from the tool?

Remove the code path from the tool. FLUTTER_DEVICELAB_XCODE_PROVISIONING_CONFIG is not in use.


feat: make totalItemCount optional in the GridItemsProvider

🙋 Feature Request
We want to use the FluentDataGrid with an external datasource (API) and basic pagination (previous/next page only).
This requires the use of a GridItemsProvider as the examples show perfectly. 💯
But the GridItemsProviderResult requires a totalItemCount, which is in our case not provided by remote API's / datasources. Only Skip and Takes are possible.
🤔 Expected Behavior
Leave the totalItemCount optional. The PaginationState allows this value te be empty as well ?!
And add some logic such that :

Whenever a page is requested and => (returnset < PageSize) or (returnset is empty) => you know that this was the last page.
Calc and update the totalItemCount based on this knowledge.

Can't you just set the totalItemCount to 0?
If you look at https://github.com/microsoft/fast-blazor/blob/V2.0.5/examples/FluentUI.Demo.Shared/Pages/DataGrid/Examples/DataGridRemoteData.razor#L39, the count is retrieved from the response but you could also just pass 0.

Closed because of no recent activity


Add core functionalities

Add these functionalities in flask
i)add task
ii)delete task/complete dask
iii)Edit task
iv)add deadline function

I can work on flask and database and add more functionalities

Hello, can you add task adding option which connects to sql db containing two tables one which has tasks and one with userID tasks table will have three columns one with task(string) 2nd with user_id and third contains priority and userID table contains two column username and user_id the user_id connects tasks with username. Can you do it?

Hello, can you add task adding option which connects to sql db containing two tables one which has tasks and one with userID tasks table will have three columns one with task(string) 2nd with user_id and third contains priority and userID table contains two column username and user_id the user_id connects tasks with username. Can you do it?

You should first get "hackoctober-accepted" so that when i contribute it should be considered for hackoctober fest 2023
I think db should contain two tables for this
1)users
user_id
user_name
... etc
2)Task
task_id
task_name
task_description
...etc
I will use mysql workbench  for db

Hello, can you add task adding option which connects to sql db containing two tables one which has tasks and one with userID tasks table will have three columns one with task(string) 2nd with user_id and third contains priority and userID table contains two column username and user_id the user_id connects tasks with username. Can you do it?

I think db should contain two tables for this 1)users user_id user_name ... etc 2)Task task_id task_name task_description ...etc
I will use mysql workbench for db

you have been assigned

@TRiyaz47 are you doing that?

As I saw your github profile. I don't think you have enough experience with github. Therefore, I am attaching my LinkedIn here. Ping me there if you need help.

As I saw your github profile. I don't think you have enough experience with github. Therefore, I am attaching my LinkedIn here. Ping me there if you need help.

Ok thanks

@TRiyaz47 are you doing that?

Yes

@TRiyaz47 are you doing that?

Checkout my hms repository, i will do this in same manner, like structure and separate files for db and main

yeah, I saw that. It will be cool. Just add comments whatever you do and also fetch the repo for new updates.

@TRiyaz47 just add the functionality. Others will do UI/UX related things and other tasks

@TRiyaz47 just add the functionality. Others will do UI/UX related things and other tasks

To show something i will basic UI then others can modify it as per their need

@TRiyaz47 just add the functionality. Others will do UI/UX related things and other tasks

To show something i will add  basic UI then others can modify it as per their need

Yup, that's what I meant!

Yup, that's what I meant!

Lets discuss somewhere else like discord

Will talk to you tomorrow 🙂. Will give you my discord ID or you can send it to me.

Will talk to you tomorrow 🙂. Will give you my discord ID or you can send it to me.

My discord username: riyazt

Will talk to you tomorrow 🙂. Will give you my discord ID or you can send it to me.

My discord username: riyazt#8648

I am now working on this,
I will now implement it using flask in which a user can add, edit ,delete tasks from frontend

There is no need. Other people are already working on it. Your Pull Request won't be accepted. So, it's totally a waste of time.

I am now working on this, I will now implement it using flask in which a user can add, edit ,delete tasks from frontend

why you didn't use SQLAlchemy for SQL operations. If you don't know about it, search and learn.

I do know about Sql alchemy but i think sql workbench is more simple and easy to use

There is no need. Other people are already working on it. Your Pull Request won't be accepted. So, it's totally a waste of time.
I have already implemented it by now, check my pull request. if you want i can work on sql alchemy

Sir @TRiyaz47 , you have done your part. Since, you are doing this for hacktober. I will suggest you to contribute to different different projects, not just one. It will make you profile awesome. Thanks again.


Fix pre-commit-check

Adding .ignore to the files config section of pre-commit-check
leads to the hook respecting the exclude patterns in ignore again so
those patterns do not have to be synced manually between excludes and
.ignore.
This commit also adds git back to the shell environment because
without it the hook doesn't find git and doesn't update the pre-commit
config on changes - you can see output warning about that when
shellHook is executed. (Haven't had time yet to understand why, but i want
this to work reliably for everyone and having git in the buildInputs isn't that big an
impact anyway).

Changes to ignore LGTM, something funny is up with git and pre-commit-hooks.nix, discussed on slack.

Just to be sure, I checked, and yep: lorri is broken with this branch :shrug:


Shappie Needs to be an API Monster

Starting with GraphQL for the database abstraction and generally becoming part of the architecture.  Website should leverage the same API's and may produce opportunities for others.

@Bakobiibizo up for another architecture session soon?

sure
On Sun, Jun 25, 2023 at 8:35 AM slouck @.***> wrote:

@Bakobiibizo https://github.com/Bakobiibizo up for another architecture
session soon?
—
Reply to this email directly, view it on GitHub
https://github.com/GATO-Framework/shappie/issues/30#issuecomment-1606135458,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A2J66FMYHCWGKY5XFJJ6FRDXNBLDJANCNFSM6AAAAAAZTG3EFY
.
 I'm around most night with FyZyX if you want to let us know when works best @Bakobiibizo.

I just threw up a vectorstore, data loaders data retrievers and a webscraper. should be useful.


Add crossbuilding support for common, avro and sql. These are needed …

…for hydra-spark replication

Codecov Report

Merging #74 into master will decrease coverage by 0.09%.
The diff coverage is 50%.

@@           Coverage Diff            @@
##           master     #74     +/-   ##
========================================
- Coverage    92.7%   92.6%   -0.1%
========================================
  Files         125     127      +2
  Lines        1946    2016     +70
  Branches      112     115      +3
========================================
+ Hits         1804    1867     +63
- Misses        142     149      +7

Impacted Files
Coverage Δ

avro/src/main/scala/hydra/avro/io/Operation.scala
0% <ø> (ø)

...ql/src/main/scala/hydra/sql/JdbcRecordWriter.scala
92.76% <50%> (-0.5%)
:arrow_down:

common/src/main/scala/hydra/common/util/Lazy.scala
83.33% <0%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5e541bd...ff43624. Read the comment docs.


Birthdates are displayed incorrectly.

What version of Node.js are you using?
v16.14.0
What version of npm are you using?
8.5.3
What operating system are you using?
Ubuntu Server 20.04
Describe the Bug
Birthdates of civilians are displayed incorrectly in browsers:

Chrome
Edge
Firefox

On operating systems:

Windows 10
Windows 11
Android 12

The correct birthdate is stored and displayed correctly on civilian edit screen, just no where else.
Images:

Expected Behavior
The birthdate should be September 15, 2000
To Reproduce
Create a civilian, set a birthdate, and view the birthdate.

Does it correctly display in the citizen search? I'm also still unable to reproduce this error 🤔

It also does not display correctly on citizen search.

What version of PostgreSQL are you using?

14.2

Can you update

Are you able to update and see if it was fixed?

One of two things happened:
I updated it, and it didn't work
I didn't update it because I don't know Postgres that much. ¯_(ツ)_/¯

Okay, I flushed cache and now it works. Thanks!


use secrets to generate worker id

The worker ID right now is typically based off the address of an object in memory. This could be guessed. While the worker is tied to a specific IP, there is a chance an off-path attacker could be hosted behind the same IP as the caller. They could possibly guess the worker id of an unclaimed session by observing the sequence of IDs presented to themselves, leading to them gaining access to an already authenticated SSH session.
Use the python secrets module to generate a cryptographically secure token to use as the worker ID. This should be much harder to guess.

Codecov Report
Base: 93.81% // Head: 93.29% // Decreases project coverage by -0.51% :warning:

Coverage data is based on head (1b62f37) compared to base (ee24eb7).
Patch coverage: 100.00% of modified lines in pull request are covered.

Additional details and impacted files
@@            Coverage Diff             @@
##           master     #305      +/-   ##
==========================================
- Coverage   93.81%   93.29%   -0.52%
==========================================
  Files           6        6
  Lines         727      731       +4
  Branches      130      130
==========================================
  Hits          682      682
- Misses         31       35       +4
  Partials       14       14

Impacted Files
Coverage Δ

webssh/worker.py
83.33% <100.00%> (+0.68%)
:arrow_up:

webssh/handler.py
95.51% <0.00%> (-0.95%)
:arrow_down:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

Merged, but found that Python 2 Python 3.4 Python 3.5 do have the secrets module.

Merged, but found that Python 2 Python 3.4 Python 3.5 do not have the secrets module.

Oh! Sorry. I didn't notice. I was going to suggest we do something else if the import fails, but I see you did that in a followup. Thanks!