glm-4-9b-chat.tokenization_chatglm

Reminder

[X] I have read the README and searched the existing issues.

System Info

llamafactory version: 0.8.4.dev0
Platform: Linux-5.4.0-99-generic-x86_64-with-glibc2.35
Python version: 3.10.14
PyTorch version: 2.2.1+cu121 (GPU)
Transformers version: 4.42.4
Datasets version: 2.20.0
Accelerate version: 0.32.0
PEFT version: 0.12.0
TRL version: 0.9.6
GPU type: Tesla V100S-PCIE-32GB
Bitsandbytes version: 0.43.2

Reproduction
Running tokenizer on dataset (num_proc=16):   0%|                                       | 0/862 [00:00<?, ? examples/s]
Traceback (most recent call last):
File "/root/miniconda3/envs/dbgpt/bin/llamafactory-cli", line 8, in
sys.exit(main())
File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/cli.py", line 111, in main
run_exp()
File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/train/tuner.py", line 50, in run_exp
run_sft(model_args, data_args, training_args, finetuning_args, generating_args, callbacks)
File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/train/sft/workflow.py", line 46, in run_sft
dataset_module = get_dataset(model_args, data_args, training_args, stage="sft", **tokenizer_module)
File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/data/loader.py", line 237, in get_dataset
dataset = _get_preprocessed_dataset(
File "/root/autodl-tmp/LLaMA-Factory/src/llamafactory/data/loader.py", line 183, in _get_preprocessed_dataset
dataset = dataset.map(preprocess_func, batched=True, remove_columns=column_names, **kwargs)
File "/root/miniconda3/envs/dbgpt/lib/python3.10/site-packages/datasets/arrow_dataset.py", line 602, in wrapper
out: Union["Dataset", "DatasetDict"] = func(self, *args, **kwargs)
File "/root/miniconda3/envs/dbgpt/lib/python3.10/site-packages/datasets/arrow_dataset.py", line 567, in wrapper
out: Union["Dataset", "DatasetDict"] = func(self, *args, **kwargs)
File "/root/miniconda3/envs/dbgpt/lib/python3.10/site-packages/datasets/arrow_dataset.py", line 3253, in map
for rank, done, content in iflatmap_unordered(
File "/root/miniconda3/envs/dbgpt/lib/python3.10/site-packages/datasets/utils/py_utils.py", line 718, in iflatmap_unordered
[async_result.get(timeout=0.05) for async_result in async_results]
File "/root/miniconda3/envs/dbgpt/lib/python3.10/site-packages/datasets/utils/py_utils.py", line 718, in
[async_result.get(timeout=0.05) for async_result in async_results]
File "/root/miniconda3/envs/dbgpt/lib/python3.10/site-packages/multiprocess/pool.py", line 771, in get
raise self._value
File "/root/miniconda3/envs/dbgpt/lib/python3.10/site-packages/multiprocess/pool.py", line 537, in _handle_tasks
put(task)
File "/root/miniconda3/envs/dbgpt/lib/python3.10/site-packages/multiprocess/connection.py", line 214, in send
self._send_bytes(_ForkingPickler.dumps(obj))
File "/root/miniconda3/envs/dbgpt/lib/python3.10/site-packages/multiprocess/reduction.py", line 54, in dumps
cls(buf, protocol, *args, **kwds).dump(obj)
File "/root/miniconda3/envs/dbgpt/lib/python3.10/site-packages/dill/_dill.py", line 498, in dump
StockPickler.dump(self, obj)
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 487, in dump
self.save(obj)
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 560, in save
f(self, obj)  # Call unbound method with explicit self
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 902, in save_tuple
save(element)
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 560, in save
f(self, obj)  # Call unbound method with explicit self
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 887, in save_tuple
save(element)
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 560, in save
f(self, obj)  # Call unbound method with explicit self
File "/root/miniconda3/envs/dbgpt/lib/python3.10/site-packages/dill/_dill.py", line 990, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 972, in save_dict
self._batch_setitems(obj.items())
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 998, in _batch_setitems
save(v)
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 560, in save
f(self, obj)  # Call unbound method with explicit self
File "/root/miniconda3/envs/dbgpt/lib/python3.10/site-packages/dill/_dill.py", line 1135, in save_functor
pickler.save_reduce(_create_ftype, (type(obj), obj.func, obj.args,
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 692, in save_reduce
save(args)
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 560, in save
f(self, obj)  # Call unbound method with explicit self
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 902, in save_tuple
save(element)
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 560, in save
f(self, obj)  # Call unbound method with explicit self
File "/root/miniconda3/envs/dbgpt/lib/python3.10/site-packages/dill/_dill.py", line 990, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 972, in save_dict
self._batch_setitems(obj.items())
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 998, in _batch_setitems
save(v)
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 603, in save
self.save_reduce(obj=obj, *rv)
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 687, in save_reduce
save(cls)
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 560, in save
f(self, obj)  # Call unbound method with explicit self
File "/root/miniconda3/envs/dbgpt/lib/python3.10/site-packages/dill/_dill.py", line 1439, in save_type
StockPickler.save_global(pickler, obj, name=name)
File "/root/miniconda3/envs/dbgpt/lib/python3.10/pickle.py", line 1076, in save_global
raise PicklingError(
_pickle.PicklingError: Can't pickle <class 'transformers_modules.glm-4-9b-chat.tokenization_chatglm.ChatGLM4Tokenizer'>: it's not the same object as transformers_modules.glm-4-9b-chat.tokenization_chatglm.ChatGLM4Tokenizer
Expected behavior
运行成功
Others
No response

去掉 preprocessing_num_workers


Add a way to disable debug logging in posthog-react-native

Is your feature request related to a problem?
When using <PostHogProvider apiKey={...} debug={__DEV__}>, PostHog produces absurd amounts of logging with "PostHog Debug" messages, especially if you have heavy instrumentation. This is very distracting and can hide more important log messages.
Describe the solution you'd like
Add an option to PostHogProvider like quiet or loggingEnabled={false} that can be used to disable the logging.
Describe alternatives you've considered

Writing really gross JSX workarounds
Patching the package with patch-package (currently doing this)

Related sub-libraries

[ ] All of them
[ ] posthog-web
[ ] posthog-node
[ ] posthog-react-native

Additional context
<3

I think the solution here would be to implement a debugLevel so you can define eg debug, error, fatal levels, and this filter out the console logs.

Btw you can still do posthog.debug(false) at runtime, or just don't use debug={__DEV__} since it's disabled by default anyway.
The loggingEnabled suggestion is pretty much what's already available.


ESA Authorizer deprecation

Authorizers are deprecated and will be removed in ESA 2.0
https://github.com/simplabs/ember-simple-auth#deprecation-of-authorizers

Closed by #226


store: Re-template ceph.conf after daemon/monitor are started

In the bin/boot scripts for store-daemon, store-metadata, store-monitor, we template /etc/ceph/ceph.conf with confd, and then exec the Ceph process. Unfortunately, this means that for long-running store components, we won't pick up changes to monitors until the container is restarted.
I think that the Ceph process will be happy as it only reads the configuration to get a list of monitors to query for state, but for anyone running ceph -s within the container, they'll see a lot of faults.
I'm hoping this can be solved as part of #2701 when we rewrite the bin/boot scripts in Go, as we'll need to run both the daemon process and confd.

I think #2925 is a better approach.


Mobile: Not showing links in top navigation bar

Good evening @mattgraham, thank you for this awesome theme! :+1:
I am currently using your theme for the website of our Android IMSI-Catcher Detector and have discovered that when accessing our site via a normal browser on the PC, it perfectly shows the links to GitHub repository and Downloads (TAR & ZIP). But when using a mobile browser on the phone, it only shows an empty bar without links to the repo and downloads, which follows when scrolling the page. It would be* lovely* to see a fix for this important Issue since our users surely would like to join our repo. ;-)

@SecUpwN not sure whats missing but if you look at the codebase in this repo (vs. the automatically generated one from GitHub) it should work fine. The above screen shot is a fresh download from the master branch.
The download links do and should go away since you can't download on a mobile device but the link to github shouldn't. Let me know if you have any further questions.

Thanks for answering my Issue. It appears as if I don't see either of these links.
Are they blocked by a modified host file when using AdAway?

@mattgraham, please respond in the pull request you've created! You will have to advice GitHub to update their copy of your theme, it would be lovely if they would do so on a regular basis. Thank you!


Adding images directory to gitignore

After deployment, the static directory will have a symlink at the path
app/images into the system's folder for greenpithumb images, but images should
be ignored by source control.
See also: https://github.com/JeetShetty/ansible-role-greenpithumb/pull/28

Coverage remained the same at 41.573% when pulling 9309ffca5072831f16eaecd40ac101eaf71226bf on mtlynch:ignore-images into 1c1893597895c8fcef728ce53bb5521c839876bb on JeetShetty:master.


Refactor SCSS/MUI to TailwindCSS - Card Component

Make sure your changes have the same if not better responsiveness, colors (theme coming so look out for that addition!!!), and general style. Thanks!

@mathcodes I would like to work on this issue please assign it to me.
thanks!

👍, thanks for stepping in!


Plugin broken v47.1

Since I've updated Sketch, this plugin doesn't work anymore. When I run it, it deletes all of my symbols. I LOVE this plugin too! Currently running Sketch 47.1

What version of Symbol Organizer are you running? There is literally no way the symbols can be removed, however there was a bug in a really old version that has long been resolved. Can you make sure you have the latest installed?

Argh! I'd been stuck on an old version of Sketch - when I updated Sketch to the latest the plugin was "updated" but was broken. I uninstalled the plugin then reinstalled and it worked. Sorry for the rookie mistake but thank you for replying, and for this plugin, I was struggling to work without it!

No worries at all @sarahvangough, I am glad Symbol Organizer is useful for you!


DRAFT: NoSessionException when user does not init()

📥 Pull Request
📘 Description
The sessions overhaul made it such that we are expecting a session when user never calls init(). For crew this shows up as @track_agent erroring bc "No session". safe_get_session() raises an error when no session exists, but no session should exist bc user never inits. Affects more than @track_agent
🎯 Goal
only check for session when init() called (global is_initialized = True)
🔍 Additional Context
User complaining in Discord and I recreated in examples/crew/job_posting.py
🧪 Testing
TODO
Thank you for your contribution to Agentops!

NoSessionException                        Traceback (most recent call last)
File ~/Desktop/agentops/AgentOps-AI/agentops/env/lib/python3.12/site-packages/agentops/meta_client.py:53, in handle_exceptions..wrapper(self, *args, **kwargs)
52 try:
---> 53     return method(self, *args, **kwargs)
54 except Exception as e:
File ~/Desktop/agentops/AgentOps-AI/agentops/env/lib/python3.12/site-packages/agentops/client.py:566, in Client._safe_get_session(self)
565 if len(self._sessions) == 0:
--> 566     raise NoSessionException("No session exists")
568 elif len(self._sessions) > 1:
NoSessionException: No session exists
During handling of the above exception, another exception occurred:
IndexError                                Traceback (most recent call last)
File ~/Desktop/agentops/AgentOps-AI/agentops/env/lib/python3.12/site-packages/agentops/meta_client.py:53, in handle_exceptions..wrapper(self, *args, **kwargs)
52 try:
---> 53     return method(self, *args, **kwargs)
54 except Exception as e:
File ~/Desktop/agentops/AgentOps-AI/agentops/env/lib/python3.12/site-packages/agentops/client.py:455, in Client.create_agent(self, name, agent_id, session)
453 else:
454     # if no session passed, assume single session
--> 455     session = self._safe_get_session()
456     session.create_agent(name=name, agent_id=agent_id)
File ~/Desktop/agentops/AgentOps-AI/agentops/env/lib/python3.12/site-packages/agentops/meta_client.py:61, in handle_exceptions..wrapper(self, *args, **kwargs)
57 if config is not None:
58     type(self).send_exception_to_server(
59         e,
60         self.config._api_key,
---> 61         self._sessions[0],  # TODO: find which session caused exception
62     )
63 raise e
IndexError: list index out of range
During handling of the above exception, another exception occurred:
IndexError                                Traceback (most recent call last)
Cell In[5], line 15
12 specific_benefits = input("What are specific_benefits you offer?\n")
14 # Create Agents
---> 15 researcher_agent = agents.research_agent()
16 writer_agent = agents.writer_agent()
17 review_agent = agents.review_agent()
Cell In[3], line 13
12 def research_agent(self):
---> 13     return Agent(
14         role="Research Analyst",
15         goal="Analyze the company website and provided description to extract insights on culture, values, and specific needs.",
16         tools=[web_search_tool, serper_dev_tool],
17         backstory="Expert in analyzing company cultures and identifying key values and needs from various sources, including websites and brief descriptions.",
18         verbose=True,
19     )
File ~/Desktop/agentops/AgentOps-AI/agentops/env/lib/python3.12/site-packages/agentops/agent.py:26, in track_agent..decorator..new_init(self, *args, **kwargs)
23     if session is not None:
24         self.agent_ops_session_id = session.session_id
---> 26     Client().create_agent(
27         name=self.agent_ops_agent_name,
28         agent_id=self.agent_ops_agent_id,
29         session=session,
30     )
31 except AttributeError as e:
32     logger.warning(
33         "Failed to track an agent. This often happens if agentops.init() was not "
34         "called before initializing an agent with the @track_agent decorator."
35     )
File ~/Desktop/agentops/AgentOps-AI/agentops/env/lib/python3.12/site-packages/agentops/meta_client.py:61, in handle_exceptions..wrapper(self, *args, **kwargs)
56 config = getattr(self, "config", None)
57 if config is not None:
58     type(self).send_exception_to_server(
59         e,
60         self.config._api_key,
---> 61         self._sessions[0],  # TODO: find which session caused exception
62     )
63 raise e
IndexError: list index out of range

this fixes it in the SDK but we still need to determine why we were being called at all if nothing agentops was in the script

as is, this breaks a lot of tests. i think this is bnot sending the first call to agentops

I refactored how state is being managed and it fixed the tests. this is now working as expected with agentops alone and with crew

Is this good to go @bboynton97 ?

Also fixed #308 🎉


Update core dependencies (CVE fixes)

Changes:

Update docker dependency
Adjust code for deprecated docker APIs

/approve
Changing this to an approve - we should bring in the ubi8 change and the dependency updates
/lgtm cancel
Looks like the switch to go 1.21 is not done right/breaking CI.

/retest

/hold

/override "Red Hat Konflux / source-to-image-enterprise-contract / source-to-image"

/hold cancel


fix(Informations): unsubcribe -> unsubscribe

:tada: This PR is included in version 1.1.41 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


[hotfix][runtime] Remove useless local variable in CompletedCheckpointStoreTest3testAddCheckpointMoreThanMaxRetained

Remove useless local variable taskStates in CompletedCheckpointStoreTest3testAddCheckpointMoreThanMaxRetained

Looks good, thank you for the patch!
Merging this...


Revert "Set Content-Type when creating WriteStream"

Reverts GoogleChrome/gulliver#51
Doesn't actually work. My browser was caching the file.

Unfortunately, doesn't actually work :(


Iamlazy Is not working properly from the homes screen icon

Hello... There is a bug on the latest version (only affects if I use the tweak from the homescreen icon)... It's not possible to create a new backup not read the previously stored backups... please fix it
Regards

Hey, thanks for reporting this!
You said this only occurs with the latest version (v1.3.0), yeah?
Also, 1) did you change Documents/ to have mobile ownership? 2) can you share the output of "stat -c '%a' /var/mobile/Documents" please?

Fixed in v1.3.1 which will be up either later tonight or early tomorrow.


Difference between “load_state” and “load_from_mobilenet”

Hello, I would like to ask the difference between“ load_state ”and “load_from_mobilenet” in the code?

thanks for your help


Add logo to favicon, navbar, and homepage

Various versions of the logo are also put in static/images so they can be accessed at heir.dev/images/...
Added credit for @edwjchen and Erin Park at the bottom of the homepage.

Screenshot:


Make collection and recording ids renamable.

Backend: restructure to use flat hierarchy to avoid having to move files when collection or recording id names change.
Frontend: Just need to add editing capability in the UI.

JSON API will be:
/api/v1/recordings/<rec>/rename/<new_rec> and /api/v1/collections//rename/<new_coll>`

on collection page, abilitiy to edit title
on collection page, ability to edit the url

allow collection title renaming
allow collection url renaming
allow recording title renaming and the url changes automatically


Anonstake gentx

Hello, your gentx seems invalid; you have used a wrong chain-id. Make sure you set a correct chain-id when you create your gentx with --chain-id=shentu-rts flag, usually when initializing your directory. Could you resubmit your gentx?


camera preview corruption

Description of the problem:
Camera shows corrupted preview immediately after starting the scan as shown in attached screenshots. Issue replicated on S7 Edge and Galaxy S4. Force stop/reinstall/change camera settings have no effect.
Which library version are you using?
3.2.0.
Which phone/tablet are you using, and which Android version does it run? (e.g. Samsung Galaxy S5,
Android 5.0)
Samsung Galaxy S4 Android 4.4.2 and 5.0.1
Does the same happen on other devices or an emulator?
App working fine on other devices
Can you reproduce the issue in the sample project included with the library? If not, can you
provide your own sample project or sample code that produces this error?
Not tried with sample project yet.
In the case of an error do you have a stack trace or adb logs?
NO

This typically happens when the device's camera does not support a specific configuration. Sometimes it can be solved by changing some camera parameters (e.g. FPS), but usually it's the easiest to use a different preview resolution.
You can start by experimentation with the scaling strategies listed here: https://github.com/journeyapps/zxing-android-embedded/blob/master/EMBEDDING.md#notes-on-scaling
It may also be helpful to check the adb logs - it shows which preview size is selected.

Hi Rkistner, Thanks for your support, I tried to change the scaling combination but it didn't made any difference.
At the same time I do Have some more detail to share.
I have found that the scanner could not scan some QR-code with poor print quality, also it takes longer time scanning good quality QR codes also, however I am able to scan same QR-code with Zxing app very quickly.
I found that the reason was that the decoder fires exception if the captured image size is larger.
Finally I fixed the issue by adding below code to the CameraManager.java-> setDesiredParameters method
......
List previewSizes = getPreviewSizes(parameters);
if (previewSizes.size() == 0) {
requestedPreviewSize = null;
} else {
requestedPreviewSize = displayConfiguration.getBestPreviewSize(previewSizes, isCameraRotated());
////////////////////////////
//code added by devendra to fix scan performance issue
if(!requestedPreviewSize.fitsIn(new Size(1200,675))){
//Log.e(TAG,"scaling the size");
requestedPreviewSize = requestedPreviewSize.scaleFit(new Size(1200,675));
}
/////////////////////////////////////////
parameters.setPreviewSize(requestedPreviewSize.width, requestedPreviewSize.height);
}
......
This does fixed the issue and the app was able to scan QR codes very quickly.
But this fix brought the Preview corruption issue on some of the devices.
Can you advice how to overcome this.

Just to clarify, do you only get that preview corruption issues when you use the changes in the setDesiredParameters method?
You mentioned you got an exception - do you have a stack trace for this?
So to summarize:

The default method picks preview size that is too large, which degrades QR scanning performance.
Changing the chosen preview size makes the scanning faster / better, but breaks the preview on some devices.

Point (2) is likely to happen when the chosen preview size is not one of the sizes that the camera specifically supports. We can solve this by instead just rejecting any previews that are too large, by changing the scoring function, e.g. here: https://github.com/journeyapps/zxing-android-embedded/blob/master/zxing-android-embedded/src/com/journeyapps/barcodescanner/camera/FitXYStrategy.java#L40

Yes the preview corruption only occurs when I apply changes in setDesiredParameters().
the exception occurs in  com.journeyapps.barcodescanner.Decoder.java class in
protected Result decode(BinaryBitmap bitmap) {
        possibleResultPoints.clear();
        try {
            if (reader instanceof MultiFormatReader) {
                // Optimization - MultiFormatReader's normal decode() method is slow.
                return ((MultiFormatReader) reader).decodeWithState(bitmap);
            } else {
                return reader.decode(bitmap);
            }
        } catch (Exception e) {
            e.printStackTrace();
            // Decode error, try again next frame
            return null;
        } finally {
            reader.reset();
        }
    }

stackTrace result is : com.google.zxing.NotFoundException
I found some idea about size of QR code from http://stackoverflow.com/a/14935871/1302592 however it looks to me that I should reduce size of captured Image not the preview itself.

Reducing the size of the preview should work, as long as you use one of the "supported" preview sizes.
Take a look at this branch:
https://github.com/journeyapps/zxing-android-embedded/compare/limit-preview-size
It's quite a bit behind master, and may require some effort to merge, but you can use that a starting point to limit the preview size.

Hi Rikistner,
Just want to update you that the solution provided to limit the preview size worked and solved the preview corruption issue, however the scan performance is a bit slower but acceptable.
Thank you very much for your support.

Closing as a device-specific issue.


feat(app): remove Change pipette ff

closes RQA-261
Overview
This removes the change pipette ff and deletes all the deprecated components. The ChangePipette parent component renders the OT-2 attach and detach flows.
Changelog

removes the ChangePipette FF and deletes all deprecated components
fixes a small bug I noticed in the ConfirmPipette page where the header was saying the incorrect info

Review requests

Walk through the attach pipette flow for an OT-2 pipette, should work as expected including the buttons and early exit buttons and error handling
walk through the detach pipette flow for an OT-2 pipette, should work as expected including the buttons and early exit buttons and error handling

Risk assessment
low

this diff 🤩


Fix info about the location of the search box in the Console app

Proposed changes
Fix info about the location of the search box in the Console app

Deploy preview for docsdocker ready!
Built with commit b0d68e62b8c19c075f70bab8566a49eaf28d1af2
https://deploy-preview-8165--docsdocker.netlify.com

@bermudezmt - LGTM


Allow hosting of Electrum data on a Docker volume

Previously, the author of the Docker image was creating both /data and /home/electrum/.electrum directories, then trying to link /home/electrum/.electrum to /data (which failed because the latter was already created).
Instead, we create /data first, then link it to /home/electrum/.electrum which allows for specifying Docker volume that persists the wallet data across container runs (as long as the Docker volume is mounted on /data).

Merged.
Thanks for your changes.


roslaunch error with gdb

it always crashed once i run launch file, when i use gdb launch file, i show the following information, anyone know how to fix it ,it means about thread error!!
[Thread 0x7fff92de9700 (LWP 32042) exited]
[New Thread 0x7fff92de9700 (LWP 32044)]
[New Thread 0x7fff935ea700 (LWP 32045)]
0

Thread 15 "darknet_ros" received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0x7fff92de9700 (LWP 32044)]
ipl_into_image (src=<optimized out>, im=...)
    at /home/liuzhiyang/yolov3/src/darknet_ros/darknet/src/image.c:604
604	                im.data[k*w*h + i*w + j] = data[i*step + j*c + k]/255.;
(gdb) quit
A debugging session is active.

and i change nvidia driver from 390 - 410, and cuda from 9.0 - 10.0, but it can not change nothing!
void ipl_into_image(IplImage* src, image im)
{
    unsigned char *data = (unsigned char *)src->imageData;
    int h = src->height;
    int w = src->width;
    int c = src->nChannels;
    int step = src->widthStep;
    int i, j, k;

    for(i = 0; i < h; ++i){
        for(k= 0; k < c; ++k){
            for(j = 0; j < w; ++j){
                im.data[k*w*h + i*w + j] = data[i*step + j*c + k]/255.;
            }
        }
    }
}

@ronwalf  @alexmillane  @ompugao @rmmcnulty9 , thanks

and i want to konw which nvidia driver、cuda 、cudnn version did u use？？？

https://github.com/pjreddie/darknet/issues/918


Multiple variables on SQL editor

Is the issue already present in https://github.com/cloudera/hue/issues or discussed in the forum https://discourse.gethue.com?
I could not find any related issue
Describe the bug:
When using the SQL editor (I've tried Impala and Spark editors) with a statement containing exactly one variable, the editor seems to be working properly (even if it shows a selector which was not present on previous version. See attached image).

If another variable is added to the SQL, it does not get added to the bottom.

I've tried the same with Hue 4.6.0 (official docker image) and it works as expected:

Steps to reproduce it?
Start Hue on Docker, configure Spark or Impala and use 2 variables on one SQL statement.
Hue version or source? (e.g. open source 4.5, CDH 5.16, CDP 1.0...). System info (e.g. OS, Browser...).
Does not work with gethue/hue:4.7.0,  gethue/hue:20200429-135001.
It works on:  gethue/hue:4.6.0

On the non working versions I can see a JS error:
Hue detected a Javascript error:  https://host/static/desktop/js/bundles/hue/vendors~hue~notebook~tableBrowser-chunk-ca7d39476e0a070525b3.bcc2121180bf.js 11813 391 Error: Cannot find closing comment tag to match:  ko if: meta.type() == 'select'
Error: Cannot find closing comment tag to match:  ko if: meta.type() == 'select'
When the second variable gets added, I can see another error:
Hue detected a Javascript error:  https:/host/static/desktop/js/bundles/hue/vendors~hue~notebook~tableBrowser-chunk-ca7d39476e0a070525b3.bcc2121180bf.js 11822 130 Error: You cannot apply bindings multiple times to the same element.
Error: You cannot apply bindings multiple times to the same element.
I got the feeling that the first error is the one who causes that appears the selector near to the first variable input and provokes the second error when another variable is added.
I've checked the source code near  ko if: meta.type() == 'select' and it seems that closing comment tag is there, but it does not seems to be there when I inspect the HTML elements.
Let me know if you need more information.

Weird, this might be related to a ko.js lib upgrade that happened since.
Wondering if we should do
</select> and not <select ... />
https://github.com/cloudera/hue/blob/master/desktop/libs/notebook/src/notebook/templates/editor_components.mako#L1220
?

Indeed the , I've fixed it with: https://issues.cloudera.org/browse/HUE-9288

https://github.com/cloudera/hue/commit/611ad1b12bd5db7a3979c0c41105d3b93903b289


[spec] Invalid spec file for jreleaser-copr

JReleaser 1.6.0 published a faulty spec at https://github.com/jreleaser/jreleaser-copr
https://github.com/jreleaser/jreleaser-copr/blob/8043dc6dc5c97413dafa66e095888724aa5b24d2/jreleaser.spec#L27
The cause is missing evaluation of the {{distributionArtifactRootEntryName}} template
https://github.com/jreleaser/jreleaser/blob/03ed28dd0e3e106b9796b152f035a8104024e4ee/core/jreleaser-templates/src/main/resources/META-INF/jreleaser/templates/java-binary/spec/app.spec.tpl#L20

🎉 This issue has been resolved in v1.7.0 (Release Notes)


ch09/ex9_32.cpp

ch09/ex9_32.cpp
FYI, I believe in Update ex9_32.cpp
iter = vi.insert(iter, *iter++); statement
will insert *iter into the container after incrementing the pointer, not before the pre-incremented iter pointer.
tested it with the statement iter = vi.insert(iter, - *iter++); so I could discriminate.  The corrected statement should be instead iter = vi.insert(iter, *iter);  ++iter;
this statement may also refers to the section of the book  4.1.3 Order of Evaluation, Precedence, and Associativity where  incrementing the second argiment will affect the first argument in the insert function
thanks,
dom68

Hi~ @dom68
Thx for issue reporting.
The current answer in this repo indeed has problem. But it isn't like what you said. First of all, the following statement is illegal :
iter = vi.insert(iter, *iter++);

Because as said in Standard [5.2.2]

The order of evaluation of arguments is unspecified.

Check this [post] (http://stackoverflow.com/questions/2934904/order-of-evaluation-in-c-function-parameters) for more discussion.
As a result, after entering function insert, iter could be its original value or original value + 1 or even anything else, depending on how compiler has been implemented.
As for your version :
iter = vi.insert(iter, *iter);
++iter;

I tested it using the code from CP5, as this:
#include <iostream>
#include <vector>
using namespace std;
int main()
{
    vector<int> vi = {0,1,2,3,4,5,6,7,8,9};
    auto iter = vi.begin();
    while (iter != vi.end())
    {
        if (*iter % 2)
        {
            iter = vi.insert(iter, *iter);
            ++iter;
        }
        else
        {
            iter = vi.erase(iter);
        }
    }
    for(auto i : vi)
        cout << i << " ";
    return 0;
}

I believe it's legal, but it led to a infinite loop. Please run it.

MooophyCpp-Primer
Thanks for you input.
dom68
Date: Sat, 10 Jan 2015 19:25:29 -0800
From<EMAIL_ADDRESS>To<EMAIL_ADDRESS>CC<EMAIL_ADDRESS>Subject: Re: [Cpp-Primer] ch09/ex9_32.cpp (#125)
Hi~ @dom68
Thx for issue reporting.
The current answer in this repo indeed has problem. But it isn't like what you said. First of all, the following statement is illegal :
iter = vi.insert(iter, *iter++);
Because as said in Standard [5.2.2]
The order of evaluation of arguments is unspecified.
Check this post for more discussion.
As a result, after entering function insert, iter could be its original value or original value + 1 or even anything else, depending on how compiler has been implemented.
As for your version :
iter = vi.insert(iter, *iter);
++iter;
I tested it using the code from CP5, as this:
#include
#include
using namespace std;
int main()
{
vector vi = {0,1,2,3,4,5,6,7,8,9};
auto iter = vi.begin();
while (iter != vi.end())
{
if (*iter % 2)
{
iter = vi.insert(iter, *iter);
++iter;
}
else
{
iter = vi.erase(iter);
}
}
for(auto i : vi)
cout << i << " ";
return 0;
}
I believe it's legal, but it led to a infinite loop. Please run it.
—
Reply to this email directly or view it on GitHub.
	 	   		  =


Setup basic CI for linting - spell checking

Like in the Go SDK, a Github Actions linting was setup to execute on each pull request. The same type of checks is needed for the pythons SDK!


Suggesting Project IDX as an Alternate Option for "Getting Started"?

Hi everyone - I'm a Product Lead at Google working on Project IDX, a cloud-based development environment. Cross-platform mobile development is a big area of focus for us.
With IDX, with just a few clicks and entirely in your browser, you can have a fully configured cloud-based environment along with Android emulators that make it easy to code/build/test/deploy mobile apps. We started with Flutter and we recently added support for React Native (using Expo): https://x.com/kirupa/status/1813690012720120225 (Our underlying code editor is CodeOSS [same as VS Code]).
I feel this might be a good complement to the current installation steps to suggest to users who want to start building React Native apps. All they need is a Google log-in, and they are good to go.
Thoughts?
Cheers,
Kirupa

Hey @kirupa
Nicola here from the React Native team at Meta.
Let me loop @brentvatne @ide on the Expo side, as my understanding is that Project IDX will work only with Expo right?

Thanks @cortinico! Right now, we only provide a React Native template with Expo configured. We can also create a React Native template without Expo if that would be another alternative you all recommend.
Taking a few steps back, you all are the React Native experts 😄  What would be the appropriate starting points that we can provide that would be beneficial to RN developers?
(One change we'll make in the near-term from Brent's feedback to us on Twitter/X, we'll explore adding an option to run a development build in the near future.)

@kirupa - do you happen to know on what timeline Google plans to begin charging for usage of IDX? It must be relatively expensive to operate! I ask because ideally we don't want to be pushing developers to a paid service in the getting started flow (Expo is a free and open source React Native framework, which you can use completely independently of EAS, the paid CI/CD services that Expo the company provides).

For #1, our plan is to always have a version of IDX available as a no-cost offering where developers can build for React Native and other frameworks/languages easily. There may be paid "add ons" (like more powerful VMs, more advanced AI capabilities, etc.), but that is something we are still in the early days of thinking about.
For #2, we are actively working on open sourcing all of our templates on Github to make it easier for developers to both learn more about how we configure Nix as well as contribute any changes. We are likely a few weeks out from being able to have that live. There are a few bugs we are working through right now (ie: onStart hooks are flaky), but we'll likely upgrade it to stable at around the same time as our templates are posted publicly.

Hi @kirupa as far as I understand, the quick solution to replace the Getting started part would be to add a Open in IDX button.
The thing is the Getting started is especially directed to contributors and as they don't have write access to the repo, they need to make a fork. But IDX does only allow to provide a static repository URL to open a project so it'll target this one rather than the fork. Is there some work to make it dynamic or context-base? Gitpod does it with a referer link: https://github.com/gitpod-io/gitpod/issues/78


Change decoding functions

Two key changes here

Each decoding function now borrows the bytes that it decodes, rather than consuming them
Each now uses a mutable position parameter. This is incremented by the number of bytes that are parsed.

What do you think? I thought these changes might make implementing the bdict_decode function easier, but I got a little carried away
UPDATE
I implemented the bdict_decode function. It's not tested very well - only has one test. Ready for encoding now!

You're fast @synlestidae, awesome work! 👍
Great changes and I agree that making bending functions borrow bytes is much more idiomatic.
I've made a number of comments, they're mostly suggestions, I am open to different ideas.
In particular however, I am not sure about position being a reference.
Let me know what you think.
Thanks!

Quite keen on this project so have been working enthusiastically on it haha. I've read your comments, will take them on board. Regarding position as a reference, I did it because it simplifies accounting for the extra element in the return type. But you've convinced me that the return type should have the new position now.

@synlestidae Haha, nice!
When you're all done, could you please squash some of the commits, (i.e some of the error handling stuff), into one and just let me know when to merge, thanks.
I hope to find time as well, so that if we can do encoding this week, perhaps we can start on the Peer-Wire protocol soon, which is the really interesting part.

Yes I didn't have time to change the position pointer (which I want to do) but will do so later on today after work. And I'll squash the commits too.

Thanks! 👍


Update ipynb

Include an example that uses both Sentinel-1 and Sentinel-2
Update S2 only example with updated function names

S2 example updated


Upgrade PostgreSQL to 9.5

Now that 9.4 is in production we can start testing 9.5 in preview
and staging.
Version change still requires a new parameter group resource, since
CloudFormation can't change the parameter group version in-place.

:+1: looks good.


addon

can u create addon for singtel tv go?

Don't think so. But I can help you to build one: not only in the Kodi part (the easy part), but learning how Singel tv go works.

Can u try?
Regards,
Syafiq

From: Javier Gonel<EMAIL_ADDRESS>Sent: Friday, July 14, 2017 3:19:39 PM
To: graffic/plugin.video.ais_playbox_unofficial
Cc: Project Adrian; Author
Subject: Re: [graffic/plugin.video.ais_playbox_unofficial] addon (#1)
Don't think so. But I can help you to build one: not only in the Kodi part (the easy part), but learning how Singel tv go works.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/graffic/plugin.video.ais_playbox_unofficial/issues/1#issuecomment-315289983, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ANGraYUpuvIUnfUDW00XXqMpkMUbvQe4ks5sNxaKgaJpZM4OVvpE.

In the way I do it. I cannot try. I need access to the device/software while it works and usually this means also being on the network of the provider. Sorry.


send mail when node becomes unreported

Is there a way to make puppetboard send a mail when a node becomes unreported?

Hi @pulven! Thanks for asking. No, there is no such feature. Actually the app is a read-only in all areas as of now and it's doesn't have any kind of email interface.
Theoretically, if you or someone else would be interested in implementing it, it could be added. However I would personally find it more interesting if it would use Slack for notifications rather than emails. We could have 2 kinds of messages sent:

notifications about nodes become unreported but maybe also about them starting to fail,
periodical summary reports per whole instance or per environment,
This seem to match with our "aiming to replace the reporting functionality" promise.

So we are open to PRs!

Does the app remain in read-only mode?

Nothing has changed since December here.

Would it be possible to get manifest versioning details for nodes in puppetboard?

Can you elaborate please? What manifest are you writing about? Does it relate to original issue about nodes becoming unreported?

@gdubicki, , I appreciate your help. I'm looking to employ a CI/CD pipeline to keep track of the versions of my manifest files (*.pp). Is there any way I can view this versioning information in the Puppet board?


[fixes #91] Document the usage of HTTP Digest method.

Changes
This adds example for using the HTTP digest method.
It also documents the format of the hash stored for MD5 digest format...to be explicit that this is the HA1 hash.
As a drive-by I have also removed some trailing spaces.
How to test
Give it a try in your favorite node HTTP server, then you can test with curl
curl -d '{"command":"do something"}' -H "Content-Type: application/json" --digest -v http://USER:PASS@localhost:port/

PS: Thanks for creating this project :)

Thanks @gevorg for looking at this PR.
Why was this closed? What is not ok with this PR?
Any feedback is much appreciated. Cheers!


validations.py has been updated.

There was an issue regarding special character validating at the first position of username
Fixes #<issue_number_goes_here>

It's a good idea to open an issue first for discussion.

[x] Tests pass
[x] Appropriate changes to README are included in PR

uigjhhkh


fix(dropdown): update dropdown item isInverse && disabled color

Updated Storybook to directly address #544, and I noticed that inverse && disabled items were the wrong color

Codecov Report

Merging #790 (2f5946a) into dev (732f5c9) will decrease coverage by 0.03%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##              dev     #790      +/-   ##
==========================================
- Coverage   86.58%   86.55%   -0.04%
==========================================
  Files         175      175
  Lines        4474     4476       +2
  Branches     1519     1520       +1
==========================================
  Hits         3874     3874
- Misses        296      297       +1
- Partials      304      305       +1

Impacted Files
Coverage Δ

...a-dom/src/components/Dropdown/DropdownMenuItem.tsx
80.00% <0.00%> (-3.02%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a12fa9c...2f5946a. Read the comment docs.


Recover password with ajax

With Laravel 5.4 I have successfully implemented Ajax with login and register form but with forgot password I have seen that it does not send 422 error response if there is any form error , instead it reloads page. If it's successful then it does not send Ajax JSON supported response.
Is there any way to make this work with ajax like login and register are already supporting Ajax.

Hi there,
Unfortunately this is not a support area for application issues. This is only for issues/bugs with the framework code itself.
Please close your issue ticket here.
You can instead ask your question on one of the many great support areas:

Laravel Slack (https://larachat.co/)
Laravel.io Forum (https://laravel.io/forum)
Laracasts Forum (https://laracasts.com/discuss)
StackOverflow (http://stackoverflow.com/questions/tagged/laravel)

Thanks in advance.

I thought it to be bug/incomplete module because as expected it should work with Ajax like login and register do. But this recover password even does not developed to throw error 422 on incorrect data input, instead its developed to redirect the user.
Sent from my Android phone. Please excuse my brevity.


Send hyperspectral indices to BETYdb

@czender @hmb1
I am updating hyperspectral extractor to use latest terrautils code. I'm also going to add support for the -m flag if an appropriate soil mask is found.
However, one last piece is @dlebauer wants to push the indices to BETYdb. I began with a snippet of code something like this:
from netCDF4 import Dataset

ind_file = "some hyperspectral indices file"
with Dataset(ind_file, "r") as netCDF_handle:
		memberlist = netCDF_handle.get_variables_by_attributes(sensor=lambda x: x is not None)
		for members in memberlist:
				# TODO: Figure out how to handle this
				data_points = _produce_attr_dict(members)

def _produce_attr_dict(netCDF_variable_obj):
	'''Produce a list of dictionary with attributes and value'''
	attributes = [attr for attr in dir(netCDF_variable_obj) if isinstance(attr, unicode)]
	result     = {name:getattr(netCDF_variable_obj, name) for name in attributes}

	return [dict(result.items()+ {"value":str(data)}.items()) for data in netCDF_variable_obj[...]]

As you have more experience with netCDF, can you help me extract appropriate trait from that Dataset?
Here is a sample CSV for BETY from the canopy cover extractor:
local_datetime,canopy_cover,access_level,species,site,citation_author,citation_year,citation_title,method
2017-07-30T14:14:44,0.524408570161,2,Sorghum bicolor,MAC Field Scanner Field Plot 0 Season 2,"Zongyang, Li",2016,Maricopa Field Station Data and Metadata,Canopy Cover Estimation from RGB images

where "canopy_cover" corresponds to a trait, not sure if one already exists for the hyperspectral index or not.
btw, here is the PR where I am implementing: https://github.com/terraref/extractors-hyperspectral/pull/32/files

HI Max,
This is the typical meta-data for an index  in  the first part of the NetCDF file:
   float NDVI705 ;
            NDVI705:_FillValue = 1.e+36f ;
            NDVI705:cell_methods = "y, x: mean" ;
            NDVI705:description = "Formula: (R750 - R705)/(R750 + R705); Citation: Gitelson and Merzlyak (1994)" ;
            NDVI705:label = "Reflectance Index" ;
            NDVI705:long_name = "Normalized Difference 750/705 Chl NDI" ;
            NDVI705:max = 0.9858156f ;
            NDVI705:min = -0.9924927f ;
            NDVI705:notes = "Normalized Difference 750/705 Chl NDI NDVI705" ;
            NDVI705:standard_name = "normalized_difference_chlorophyll_index_750_705" ;
            NDVI705:type = "trait" ;
            NDVI705:units = "ratio" ;

In the data: section there will the value of the index (averaged over the plot )
NDVI705 = -0.1020982 ;

@max-zilla the variable name should match one in BETYdb, e.g.
https://terraref.ncsa.illinois.edu/bety/api/beta/variables?key=9999999999999999999999999999999999999999&name=NDVI705

@hmb1 @czender I feel like I'm close, but can't get a value for NDVI705 by plot.
On Roger:
module load netCDF
module load pythonlibs
python

then in python...
>>> f = r"/projects/arpae/terraref/sites/ua-mac/Level_1/hyperspectral/2017-07-10/2017-07-10__18-06-40-881/710ddf11-e2f2-483c-b0c2-a223cdf3fdff_ind.nc"
>>> nc = Dataset(f, "r")
>>> nc.ncattrs()
[u'title', u'created_by', u'Conventions', u'Project', u'terraref_script', u'workflow_invocation', u'terraref_hostname', u'terraref_version', u'feature', u'history', u'NCO', u'history_of_appended_files', u'nco_openmp_thread_number', u'camera']
>>> nc.getncattr('NCO')
u'"4.6.6-alpha03"'
>>> nc.get_variables_by_attributes(standard_name='NDVI705')
[]
>>> nc.get_variables_by_attributes()
[]

Can you show me correct python here? Unless the problem is more complex than I understand - do we have per-plot values for NDVI705 in this file and we need to iterate over something?
I'm trying to use http://unidata.github.io/netcdf4-python/#netCDF4.Dataset to figure this out as it seems like it should be quick, but I can't

@max-zilla the _ind.nc files are full resolution. I believe that these still need to be averaged by plot before exporting to BETYdb. This is covered by #183, where the task of averaging at plot level has been checked, though it is not clear if this has actually been done.
I suspect @hmb1 or @czender can provide an efficient implementation using NCO or similar.

HI Max,
the actual netcdf name of the variable is 'NDVI705'
and  standard_name = "normalized_difference_chlorophyll_index_750_705"
the data for NDVI705 is a  scalar and represents the average value over the plot
The variable NDVI705_pxl below is the per-pixel value over the plot
float NDVI705_pxl(y, x) ;
NDVI705_pxl:_FillValue = 1.e+36f ;
NDVI705_pxl:cell_methods = "y, x: maximum" ;
NDVI705_pxl:long_name = "Reflectance of image" ;
NDVI705_pxl:standard_name = "surface_albedo" ;
NDVI705_pxl:units = "1" ;
...Henry

the data for NDVI705 is a  scalar and represents the average value over the plot

The file spans many plots, so one average value will not be particularly meaningful. I think @max-zilla has implemented code to subset by the plot boundary, average, and insert into BETYdb.

The variable NDVI705_pxl below is the per-pixel value over the plot

I think that the averages from above can be dropped from the file and the suffix "_pxl" removed from these variable names.

Thats quite a bit of work and all the attributes are associated with the  root name and not the _pxl name

@dlebauer @hmb1 in this snippet of python code:
with Dataset(ind_file, "r") as netCDF_handle:
			ndvi = netCDF_handle.get_variables_by_attributes(
					standard_name='normalized_difference_chlorophyll_index_750_705')
			NDVI705 = ndvi[0].getValue().ravel()[0]

...my thinking had been that I could use Dataset() with x/y coordinates to query only a subset of the .nc file (if that's possible), collect all the per-pixel values for that bounding box and average them.
Since the file is 100 GB, i could see that being slow.
A middle ground that is probably not satisfying would be to assign the single NDVI705 value we calculate for the swath, and assign it to all plots covered by that swath...

@hmb1 what is nco command to take a hyperslab and average the values in the array?

with the indices file we have the coordinates x,y
so to   subset using the bounding box xmin,xmax ymin, ymax
ncks -d x, xmin,xmax -d y ymin,ymax    <netcdf_in_file> <netcdf_out_file>
Very important the xmin,xmax etc must be floating point numbers other wise NCO will interpret them as an index number
e.g

ncks d x, 0.4,5.0 -d y 10.0,15.4 in.nc out.nc

...Henry

Stale issue, closing. @dlebauer   please open a new issue if work remains.


How we can set window image size on 112x112 image

Hi
Thank you for your great work. My Image size is 112x112 and the head is 12 and my window size is 7. It does not work for me.
Traceback
  File "/raid/khawar/PycharmProjects/thesis/vit_pytorch/SwinT/swin.py", line 111, in forward
    q, k, v = map(
  File "/raid/khawar/PycharmProjects/thesis/vit_pytorch/SwinT/swin.py", line 112, in <lambda>
    lambda t: rearrange(t, 'b (nw_h w_h) (nw_w w_w) (h d) -> b h (nw_h nw_w) (w_h w_w) d',
  File "/raid/khawar/anaconda3/envs/vision-transformer-pytorch/lib/python3.8/site-packages/einops/einops.py", line 424, in rearrange
    return reduce(tensor, pattern, reduction='rearrange', **axes_lengths)
  File "/raid/khawar/anaconda3/envs/vision-transformer-pytorch/lib/python3.8/site-packages/einops/einops.py", line 376, in reduce
    raise EinopsError(message + '\n {}'.format(e))
einops.EinopsError:  Error while processing rearrange-reduction pattern "b (nw_h w_h) (nw_w w_w) (h d) -> b h (nw_h nw_w) (w_h w_w) d".
 Input tensor shape: torch.Size([1, 3, 3, 384]). Additional info: {'h': 24, 'w_h': 7, 'w_w': 7}.
 Shape mismatch, can't divide axis of length 3 in chunks of 7

Regards,
Khawar

I noticed that many people use 224224 pictures as datasets, 224 can be divisible by 7. I also encountered this problem when using 512512 pictures. In order to be divisible, I set all the default parameters of model/swin_transformer (window_size=7) modified to 8 :)

@Nial4 I am also facing the same for size 112 but still not working. Any advice?

Because from stage1 to stage3, the image size needs to be divisible by 4, and the windows size is required to be divisible by 7, so I suggest maybe you can try to resize the image to 128 * 128, and then change SwinTransforme init and WindowAttention init let window_size=8

Hi
Thank you for your great work. My Image size is 112x112 and the head is 12 and my window size is 7. It does not work for me.
Traceback
  File "/raid/khawar/PycharmProjects/thesis/vit_pytorch/SwinT/swin.py", line 111, in forward
    q, k, v = map(
  File "/raid/khawar/PycharmProjects/thesis/vit_pytorch/SwinT/swin.py", line 112, in <lambda>
    lambda t: rearrange(t, 'b (nw_h w_h) (nw_w w_w) (h d) -> b h (nw_h nw_w) (w_h w_w) d',
  File "/raid/khawar/anaconda3/envs/vision-transformer-pytorch/lib/python3.8/site-packages/einops/einops.py", line 424, in rearrange
    return reduce(tensor, pattern, reduction='rearrange', **axes_lengths)
  File "/raid/khawar/anaconda3/envs/vision-transformer-pytorch/lib/python3.8/site-packages/einops/einops.py", line 376, in reduce
    raise EinopsError(message + '\n {}'.format(e))
einops.EinopsError:  Error while processing rearrange-reduction pattern "b (nw_h w_h) (nw_w w_w) (h d) -> b h (nw_h nw_w) (w_h w_w) d".
 Input tensor shape: torch.Size([1, 3, 3, 384]). Additional info: {'h': 24, 'w_h': 7, 'w_w': 7}.
 Shape mismatch, can't divide axis of length 3 in chunks of 7

Regards,
Khawar

You may change the window size of the last stage as 3x3 or 4x4 (the feature map size). Another solution is to use padding.

Hi @Nial4,
Following your suggestion, I modify window_size to 8 when training model with 512, 512 image.
I will encounter size mismatch with relative_position_index and head when loading pre-trained weight, will these change drop perfromance of Swin transformer? And how can I deal with these,  I set strict=False, but It still has error when loading pre-trained weight.
Is there any documentation on fine-tuning the Swin transformer? I have no idea for it.
Thanks for your reply in advance!

HI @Nial4 ,
Thanks for your reply.
Does your retraining include pre-trained weights?
If I modify the window size to retrain, can I use the pre-trained weight  and just need to remove the mismatch parameters?
Thanks!

HI@Nial4  ,
I meet a data problem. Could you give me some advice. I use the swin_transformer as my backbone for segmentation. My train_size is 256, and window_size was set to 8, but when I train it, I get the error:
RuntimeError: Expected 4-dimensional input for 4-dimensional weight [12, 192, 1, 1], but got 3-dimensional input of size [16, 1, 1] instead
I have tried many times such as add a inputs=torch.unsqueeze(inputs, dim=0) but I failed.
Thanks for your time.
best

Hi @Nial4 ,
I meet a data problem. Could you give me some advice. I use the swin_transformer as my backbone for segmentation. My train_size is 256, and window_size was set to 8, but when I train it, I get the error:
RuntimeError: Expected 4-dimensional input for 4-dimensional weight [12, 192, 1, 1], but got 3-dimensional input of size [16, 1, 1] instead
I have tried many times such as add a images=torch.unsqueeze(images, dim=0) but I failed.
Thanks for your time.
best

Please go to Swin V2 for an approach to deal with varying window resolutions.

You can try bicubic interpolation to leverage the pretrained model weights with different window size


How to get the infered type parameters for a function call.

Golang is less flexiable when it comes to infer generic type params, one noticable diffrence is that the assignee is not taken into account. https://stackoverflow.com/questions/72174526/is-it-possible-to-infer-type-parameters-from-what-return-values-are-assigned-to.
I see in reflaxe.cpp some code but I am unable to follow, also I am not sure whether the meta is explicitly added.
https://github.com/SomeRanDev/reflaxe.CPP/blob/main/src/cxxcompiler/subcompilers/Expressions.hx#L1479
How is possible to extract the concrete type that haxe infered for the generic call?
I also suspect the @:generic doesnt work yet from reflaxe.

You're looking for TypeHelper.findResolvedTypeParams. I usually use it like this: using reflaxe.helpers.TypeHelper.
You can see it being used here:
https://github.com/SomeRanDev/reflaxe.CPP/blob/0630b5824b5574e368d622c37588b70869d312af/src/cxxcompiler/subcompilers/Expressions.hx#L1525
Ignore anything with @:templateArg/Meta.TemplateArg, this is for adding C++ constant values using templates:
void something<int a>() { std::cout << a << std::endl; }

I haven't used @:generic a lot, but I assume the Haxe compiler takes care of it and generates the classes before Reflaxe does anything. So it should work? I could be wrong, I haven't tested it.


Add persistent storage

There are a number of feature requests that require some form of persistent storage:

https://github.com/se1exin/Cleanarr/issues/11 - Store space saved
https://github.com/se1exin/Cleanarr/issues/19 - Store ignored media items
https://github.com/se1exin/Cleanarr/issues/47 - Store ignored media items
https://github.com/se1exin/Cleanarr/issues/50 - Cache results (although caching may not need to be persisted - in-memory may suffice)

~SQLite is probably the most robust/contribution friendly~ - tinydb used instead
~Re: Storing ignored items. Since the plex API doesn't support excluding items in a search request, implementation of paging will be required to skip over the ignored items~ - Implemented

Persistent storage implemented. Will continue to track #50 in that item.


[Maulik] batch commits from offset commit worker

Address Issue #44 by introducing batch commits in OffsetCommitWorker

Codecov Report

Merging #45 into master will increase coverage by 0.82%.
The diff coverage is 91.83%.

@@             Coverage Diff              @@
##             master      #45      +/-   ##
============================================
+ Coverage     81.73%   82.56%   +0.82%
+ Complexity      257      255       -2
============================================
  Files            52       52
  Lines           805      820      +15
  Branches         73       71       -2
============================================
+ Hits            658      677      +19
+ Misses          126      120       -6
- Partials         21       23       +2

Impacted Files
Coverage Δ
Complexity Δ

.../gojek/beast/protomapping/ProtoUpdateListener.java
57.62% <50.00%> (+4.59%)
5.00 <0.00> (ø)

...ava/com/gojek/beast/worker/OffsetCommitWorker.java
94.91% <92.50%> (-5.09%)
11.00 <2.00> (+1.00)
:arrow_down:

...ain/java/com/gojek/beast/commiter/OffsetState.java
100.00% <100.00%> (+6.25%)
10.00 <4.00> (-3.00)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 304883e...f24e943. Read the comment docs.

LGTM


Error executing imported Keras model whith reshape and LSTM

Running an imported Keras model which contains a reshape and a LSTM throws an exception
I am able to import the following Keras model keras-model.zip but I'm not able to use it.
final ComputationGraph computationGraph = KerasModelImport.importKerasModelAndWeights(
        "keras-model.h5", false
);
System.out.println(computationGraph.summary());
final INDArray inputArray = Nd4j.rand(1, 3);
computationGraph.outputSingle(inputArray);

The summary of the ComputationGraph:
===========================================================================================================
VertexName (VertexType)          nIn,nOut   TotalParams   ParamsShape                         Vertex Inputs
===========================================================================================================
input_1 (InputVertex)            -,-        -             -                                   -
dense_1 (DenseLayer)             3,10       40            W:{3,10}, b:{1,10}                  [input_1]
reshape_1 (PreprocessorVertex)   -,-        -             -                                   [dense_1]
lstm_1 (LastTimeStepLayer)       5,32       4864          W:{5,128}, RW:{32,128}, b:{1,128}   [reshape_1]
dense_2 (DenseLayer)             32,1       33            W:{32,1}, b:{1,1}                   [lstm_1]
-----------------------------------------------------------------------------------------------------------
            Total Parameters:  4937
        Trainable Parameters:  4937
           Frozen Parameters:  0
===========================================================================================================

The exception when the imported graph is used:
Exception in thread "main" org.deeplearning4j.exception.DL4JInvalidInputException: Received input with size(1) = 2 (input array shape = [1, 2, 5]); input.size(1) must match layer nIn size (nIn = 5)
	at org.deeplearning4j.nn.layers.recurrent.LSTMHelpers.activateHelper(LSTMHelpers.java:188)
	at org.deeplearning4j.nn.layers.recurrent.LSTM.activateHelper(LSTM.java:163)
	at org.deeplearning4j.nn.layers.recurrent.LSTM.activate(LSTM.java:140)
	at org.deeplearning4j.nn.layers.recurrent.LastTimeStepLayer.activate(LastTimeStepLayer.java:80)
	at org.deeplearning4j.nn.graph.vertex.impl.LayerVertex.doForward(LayerVertex.java:110)
	at org.deeplearning4j.nn.graph.ComputationGraph.outputOfLayersDetached(ComputationGraph.java:2316)
	at org.deeplearning4j.nn.graph.ComputationGraph.output(ComputationGraph.java:1779)
	at org.deeplearning4j.nn.graph.ComputationGraph.outputSingle(ComputationGraph.java:1761)
	at org.deeplearning4j.nn.graph.ComputationGraph.outputSingle(ComputationGraph.java:1747)
	at org.deeplearning4j.nn.graph.ComputationGraph.outputSingle(ComputationGraph.java:1628)

This bug is very similar with the issue #4556 but the solution cannot be applied. The solution was to process the data before injecting them in the graph. In this case I can't do this the reshape + LSTM is not at the beginning of my graph.
We should be able to import or convert this Keras model in order to use it in dl4j.
Version Information

Deeplearning4j version : 1.0.0-beta3
Platform information : Ubuntu 16.04.5 LTS
CUDA version : None
NVIDIA driver version : None
Keras version : 2.2.4

Closing due to how old this is. It's likely related to our NWC/NCW support. We should be fine with this now. For anyone in the future, please open a new issue if you run in to something similar.


Create wheels.yml

I was wondering what is the status of this PR.

I've published wheels from my fork without issues. I dont currently have any plan to merge.

I've published wheels from my fork without issues. I dont currently have any plan to merge.

Could you share the branch that it is working? I was wondering what it is missing to be able to merge to master from your fork. I would like to learn, so this is done here every time we have a new commit or a new release (perhaps triggered manually).


WIP: Sparse array types

PR intended for discussion

Hmm interesting. Can you say a few words about the motivation for this? My first reaction is that "array" seems like a confusing way to have to think about these data structures -- among other things there's no particular sequence to them.

The initial motivation was fixing the discrepancy between few places that declared { [number]: ... } but initialized it as []...
Our usage was curiously independent of wether the value was object or an array.
After some time (yesterday at our call already) I decided things should go the other way around - the initialization with [] should be fixed to {}.
After some research, I do not think there is a good reason to use sparse arrays over objects. Likely the implementation internally is similar. This was an interesting read that I found regarding this topic:
https://news.qooxdoo.org/javascript-array-performance-oddities-characteristics-d8139757b238

Sounds good. Thanks for the update, and the link!


Improve file watching

Is your feature request related to a problem or a nice-to-have?? Please describe.
When using the --watch option Mocha reruns tests when files change. This is quite helpful but the current implementation suffers from a couple of problems. I’d be more than glad to implement the required changes.
Current problems

New files are not picked up (#2176)
What files to watch can only be controlled by the extensions configuration. In particular that makes the following uses impossible:

Only watch files in a certain directory (#2702)
Watch files without extensions
Exclude certain files and directories from watching (#2554)

It always uses the slow fs.watchFile even when fs.watch is available.
It is impossible to watch files in node_modules and .git

Describe the solution you'd like

Use chokidar to get reliable and fast file watching.
Add a watchFiles (name subject to bikeshedding) configuration option that accepts a list of file paths, directories, and globs to watch.
Rerun tests when a file matching watchFiles is added
Add watchIgnore (name subject to bikeshedding) that accept a list of globs to exclude from watching. Defaults to ['node_modules', '.git/**']
Keep backwards compatibility if none of the new options are specified

Describe alternatives you've considered
Using nodemon would address all the problems. Since this creates a new process on file changes this approach is to slow, especially when using Babel or TypeScript for on-the-fly compilation. There also has been talk (#1780) of deprecating the --watch options and use separate tools to accomplish reruns. However people are relying on watch (https://github.com/mochajs/mocha/issues/1780#issuecomment-373974766).

@geigerzaehler yesterday I tried to get into this "watch" topic with #3851. I  realised there should be two lists - a watch list and a test list - and the current solution has to be improved or deprecated otherwise.
I would be very happy to get your help with these improvements. So please go ahead with your implementation! In this repo sometimes it can be very painful to push big changes upto the final merge. I will do my best to support you.
What are your reasons for choosing "chokidar"?

Thanks for the support @juergba!

I realised there should be two lists - a watch list and a test list - and the current solution has to be improved or deprecated otherwise.

If I understand you correctly my proposal is in line with your observation. (Please correct me if I’m wrong.) I’d be interested in more of your thoughts on this topic.

What are your reasons for choosing "chokidar"?

It solves the problems I described above with a nice API
It is widely used, including large projects like Webpack (dependents on NPM)
It is actively developed
Code quality seems good and its test suite is quite large (and uses mocha :wink:)

I’m not aware of any alternatives with some major advantage.

Yes, we are inline. There must be a way to choose the directories/files being watched. Currently the cwd is selected and we have no option to change this.
Just for my understanding: everything you propose could be achieved with Node's FSWatcher, but chokidar has the better/faster one, right?
Probably it's best to extract the watcher into a seperate modul. I'm waiting for the confirmation we can use ES6. Since we are still supporting IE11, we are forced to code in ES5 in most of our modules.
Configuration options: I don't know yet how we will handle this. It could be via CLI, via Mocha's configuration files or both.
Mocha still has some unsolved issues with re-running tests, I hope we will get around this.
I found an older proposition which also uses chokidar mocha-watch. Maybe you can have a look at it to get some ideas.

Just for my understanding: everything you propose could be achieved with Node's FSWatcher, but chokidar has the better/faster one, right?

Yes, chokidar can be faster and does not have the quirks node’s filesystem watch API has. It may use the Node API under the hood, though.. On MacOS it uses fsevents which is generally faster and has fewer issues.

Probably it's best to extract the watcher into a seperate modul.

👍

Mocha still has some unsolved issues with re-running tests, I hope we will get around this.
Could you post links to the issues that I did not yet include in the description here so that I can try to fix them if possible?

ES6: should be ok, see our gitter conversation

.eslintrc.yml: add the watch module to overrides
package-scripts.js: add --ignore chokidar to the build script browserify ...
package.json: add chokidar: false to browser

re-run issues: have been reported for years, see f.e. #736, #1938
The most actual issue is probably: #2783
PS: please try to keep this PR as lean as possible. It's far easier to get reviews for smaller PR's than for bigger ones.

@geigerzaehler is there anything I can do to go on with this one?


run deepsomatic on HPC

Hi Deepsomatic team,
I want to run the deepsomatic without root permission on HPC. But I noticed it always uses Python or Deepsomatic in default folders (from setting.sh).

Operating system: Linux

version: 1.8.0

Installation method (Docker, built from source, etc.): singularity pull docker://google/deepsomatic:1.8.0

Type of data: WES tumor only

Command:

export INPUT_DIR='/project/CPRIT_solid/'
export OUTPUT_DIR='/project/SARC9_PDX_WES'
export REF_DIR='/home/hef/Data/hg38/resources_broad_hg38_v0'
export SIF_DIR='/home/hef/sif_image'
singularity exec -B  ${SIF_DIR}:${SIF_DIR} -B ${REF_DIR}:${REF_DIR} -B ${INPUT_DIR}:${INPUT_DIR} -B ${OUTPUT_DIR}:${OUTPUT_DIR} ${SIF_DIR}/deepsomatic_1.8.0.sif run_deepsomatic --model_type=WGS_TUMOR_ONLY --ref=${REF_DIR}/Homo_sapiens_assembly38.fasta --reads_tumor=${INPUT_DIR}/SARC9_PDX_WES.dedupped.realigned.recal.bam --output_vcf=${OUTPUT_DIR}/SARC9_PDX_WES.vcf.gz --output_gvcf=${OUTPUT_DIR}/SARC9_PDX_WES.g.vcf.gz --sample_name_tumor=SARC9_PDX_WES --num_shards=4 --logging_dir=${OUTPUT_DIR}/logs --use_default_pon_filtering=true

Error trace:

INFO:    Converting SIF file to temporary sandbox...
FATAL:   while extracting /home/hef/sif_image/deepsomatic_1.8.0.sif: root filesystem extraction failed: extract command failed: WARNING: Could not lookup the current user's information: user: unknown userid 92623
FATAL:   Couldn't determine user account information: user: unknown userid 92623
: exit status 255
srun: error: c002: task 0: Exited with exit code 255

Thanks.
FN

I am also having issues running deepsomatic on an HPC
..see #32


Fix typo in analogsignal repr

Fixes #1354
@samuelgarcia,
That is a real typo that needs to be fixed.

I have no clue why the tests are failing in some versions?

Failing tests are unrelated

@samuelgarcia can you merge this?


Allow page author into the negotiation

As we've discussed, I was using something similar to this at my last company. The one difference is that I involved the page author in the negotiation as well. This is very useful, I think, both for maintenance and performance.
It seems to me you could pretty easily add a flag to support this in the same codebase, but if not I'm willing to fork it or something to try it out too.  Anyway, here's specifically what I am proposing:

We create a open-styleable-mode concept.  It has an assumed value, if not present or a known value of, basically 'auto' which just is 'everything is copied down' as you do now.
Authors can add an attribute to the document element to provide an explicit value <html open-stylable-mode="explicit"> and then tag the ones that they want to take like <style open-stylable>.

This should really only add 2 lines of code to support.  wdyt?

This is an interesting idea, but I think this is probably a better feature for a fork than for this project.
This project is mostly intended as a small proof-of-concept (the whole code is less than 100 lines). There are definitely lots of different ways you could do this kind of styling negotiation, e.g.:

Page author controls which components are opted-in
Page author controls which stylesheets are opted-in
Component author decides, and all stylesheets are opted-in (this repo)
Stylesheet author decides, all components are opted-in
Some mix-and-match of the above

Another point I was trying to make in this repo is that, if https://github.com/WICG/webcomponents/issues/909 is so needed, then web authors should be beating down the door for a polyfill like this. The fact that this is still basically a proof-of-concept makes me think it's either not that needed, or the design is not right, or people are just allergic to polyfills these days and are waiting for the real deal.


ClearAllBookmarks does not refresh

After ClearAllBookmarks command, the view is not refreshed and a reload is mandatory to se new tree status ...

Confirmed this bug on my installation.

Not a bug on Mac. I'll check Windows tonight. This bug may have been fixed since last June.

This appears to be working correctly now. I'm going to go ahead and close this one.

👍


Handle same executables in two different Singularity containers

If the user loads a Singularity container that has executables with identical names to those in another container, the container that was loaded second in line will take precedence.
For example. if the user ran:
module load minc/1.9.17
module load fsl/6.0.3
h5ls

Running h5ls will execute the h5ls included in fsl.
This behaviour might be very confusing to users, as they might not be aware that the executable is even included in the 2nd container they loaded, and won't understand why the command behaviour might have changed.
I suggest that each time a container is loaded, we will check that there is no conflict between executables. If a conflict exits, we can print a big warning saying:
WARNING: conflict between the following executables in minc/1.9.17 and fsl/6.0.3:
h5ls
h5jam
h5dump
Notice that these executables will be ran from fsl/6.0.3

Dear @civier
This behaviour is standard linux and module behaviour and is in my opinion what every user should expect. If people don't want to deal with this complexity they should launch containers from the application menu instead of using the advanced way.
printing your proposed warning could lead to a slow module loading behaviour, so if this feature is important to you, then I recommend that you implement it and test first how big this delay is. If it's reasonable I am happy to accept a pull request from you to implement this feature.

Sounds good. I actually have it half-done already :-)
However, testing will have to wait until I wrap up my pending manuscripts
first.
Cheers,
Oren
--
Oren Civier
Neuroimaging Informatics Fellow
Swinburne Neuroimaging | National Imaging Facility
https://anif.org.au/team/oren-civier/
https://www.swinburne.edu.au/neuroimaging
Swinburne University of Technology
Hawthorn Campus, Advanced Technologies Centre, Room 914
+61 3 9214 4628 | +61 4 3101 6603
@.*** (Email/Teams video call)
https://twitter.com/orencivier
On Fri, 18 Jun 2021, 08:22 Steffen Bollmann, @.***>
wrote:

Assigned #65 https://github.com/NeuroDesk/neurodesk/issues/65 to @civier
https://github.com/civier.
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/NeuroDesk/neurodesk/issues/65#event-4906840399, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AB7FUI2AVSDV5BEMSENWIFLTTJYQTANCNFSM463UFPFA
.

closed, because this is how the module system works and is supposed to work.


Repo was renamed but the code didn't get the memo

What is the current behavior?
Things are broken.
More specifically, the import paths, go.mod and builder config reference a non-existent repository.
What is the new behavior?
Things are not broken.
More specifically, the import paths, go.mod and builder config reference the actual repository.

Pull request checklist
Please check if your PR fulfills the following requirements:

[X] Tests(make test) for the changes have been added (for bug fixes / features) and pass
[ ] Docs have been reviewed and added / updated if needed (for bug fixes / features)
[X] Lint (make lint) has passed locally and any fixes were made for failures

Pull request type

Please check the type of change your PR introduces:

[X] Bugfix
[ ] Feature
[ ] Code style update (formatting, renaming)
[ ] Refactoring (no functional changes, no api changes)
[ ] Build related changes
[ ] Documentation content changes
[ ] Other (please describe):

Does this introduce a breaking change?

[ ] Yes
[x] No

@smithclay I believe once this is merged and your PR #13 is rebased onto main the lint errors will be resolved.


Always dump log from upgrade test.

Also fixed a typo in where the "Code 200" message is checked.

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: hklai
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

tests/OWNERS [hklai]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

/lgtm

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: hklai, ostromart
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

tests/OWNERS [hklai]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


Bugfix/fallback to any camera

As far as I can tell now, yes (I'm quite new with React Native-based development, so I'm wondering if I'm missing something). Stuff no longer crashes and burns. I take that as a good thing.


Issue with Path Frontend Rule in Docker Swarm

Do you want to request a feature or report a bug?
BUG
What did you do?
I was configuring a couple of backends that were going to be accessed with a Specific Path on the default domain.
Our Environment is Docker Swarm.
We are deploying all containers via stack files
traefik has been deployed (via stack, whose configuration is futher down), and is part of the proxy network to which all stacks are deployed into.
The labels we added to one of the stack files are like this:
      labels:
        - "traefik.port=8092"
        - "traefik.docker.network=proxy"
        - "traefix.protocol=http"
        - "traefik.tags=solr-update"
        - "traefik.backend=solr-update"
        - "traefik.frontend.rule=Path:/solr-update"

Note that when we deploy a stack with a specific Host entry, it works fine.
I have tried adding a HOST entry as part of the traefik.frontend.rule, but that did not work.
What did you expect to see?
I expected to see a working http connection to the container.
What did you see instead?
I saw a 404 Not Found.
Here are the results of curl connections to the container:
curl -v http://<IP_ADDRESS>:8092/solr-update/healthcheck
* Hostname was NOT found in DNS cache
*   Trying <IP_ADDRESS>...
* Connected to <IP_ADDRESS> (<IP_ADDRESS>) port 8092 (#0)
> GET /solr-update/healthcheck HTTP/1.1
> User-Agent: curl/7.35.0
> Host: <IP_ADDRESS>:8092
> Accept: */*
>
< HTTP/1.1 200 OK
< Date: Thu, 19 Oct 2017 02:11:31 GMT
< Content-Type: text/plain; charset=utf-8
* Server Kestrel is not blacklisted
< Server: Kestrel
< Transfer-Encoding: chunked
<
OK - Solr-Update
 ConfigName: Testing
 SolrServer: http://IT205183.thewarehousegroup.net:8983
 User      : UpdateUser
 Password  : ************
* Connection #0 to host <IP_ADDRESS> left intact

and via traefik:
curl -v http://whakldman01d.thewarehousegroup.net/solr-update/healthcheck
* About to connect() to whakldman01d.thewarehousegroup.net port 80 (#0)
*   Trying <IP_ADDRESS>...
* Connected to whakldman01d.thewarehousegroup.net (<IP_ADDRESS>) port 80 (#0)
> GET /solr-update/healthcheck HTTP/1.1
> User-Agent: curl/7.29.0
> Host: whakldman01d.thewarehousegroup.net
> Accept: */*
>
< HTTP/1.1 404 Not Found
< Content-Type: text/plain; charset=utf-8
< X-Content-Type-Options: nosniff
< Date: Thu, 19 Oct 2017 02:14:16 GMT
< Content-Length: 19
<
404 page not found
* Connection #0 to host whakldman01d.thewarehousegroup.net left intact

Output of traefik version: (What version of Traefik are you using?)

Traefik is deplyed via a stack file, which is below:
version: "3"

services:

  traefik:
    image: traefik
    ports:
      - 80:80
      - 443:443
      - 8080:8080
    networks:
      - proxy
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock
    command: -c /dev/null
      - --web
      - --docker
      - --docker.domain=whakldman01d.thewarehousegroup.net
      - --docker.watch
      - --logLevel=DEBUG
      - --docker.swarmmode=true
      - --docker.exposedbydefault=true
      - --defaultEntryPoints='http'
    deploy:
      replicas: 1
      restart_policy:
        condition: on-failure
        delay: 10s
        max_attempts: 12
        window: 200s
      resources:
        limits:
          cpus: '0.5'
          memory: 20M

networks:
  proxy:
    external: true

If applicable, please paste the log output in debug mode (--debug switch)
time="2017-10-18T22:02:28Z" level=info msg="Using TOML configuration file /dev/null"
time="2017-10-18T22:02:28Z" level=info msg="Traefik version v1.4.0 built on 2017-10-16_04:52:07PM"
time="2017-10-18T22:02:28Z" level=debug msg="Global configuration loaded {"GraceTimeOut":10000000000,"Debug":false,"CheckNewVersion":true,"AccessLogsFile":"","AccessLog":null,"TraefikLogsFi
le":"","LogLevel":"DEBUG","EntryPoints":{"http":{"Network":"","Address":":80","TLS":null,"Redirect":null,"Auth":null,"WhitelistSourceRange":null,"Compress":false,"ProxyProtocol":null,"Forwa
rdedHeaders":{"Insecure":true,"TrustedIPs":null}}},"Cluster":null,"Constraints":[],"ACME":null,"DefaultEntryPoints":["http"],"ProvidersThrottleDuration":2000000000,"MaxIdleConnsPerHost":200
,"IdleTimeout":0,"InsecureSkipVerify":false,"RootCAs":null,"Retry":null,"HealthCheck":{"Interval":30000000000},"RespondingTimeouts":null,"ForwardingTimeouts":null,"Docker":{"Watch":true,"Fi
lename":"","Constraints":null,"Trace":false,"DebugLogGeneratedTemplate":false,"Endpoint":"unix:///var/run/docker.sock","Domain":"whakldman01d.thewarehousegroup.net","TLS":null,"ExposedByDef
ault":true,"UseBindPortIP":false,"SwarmMode":true},"File":null,"Web":{"Address":":8080","CertFile":"","KeyFile":"","ReadOnly":false,"Statistics":null,"Metrics":null,"Path":"","Auth":null,"D
ebug":false,"CurrentConfigurations":null,"Stats":null,"StatsRecorder":null},"Marathon":null,"Consul":null,"ConsulCatalog":null,"Etcd":null,"Zookeeper":null,"Boltdb":null,"Kubernetes":null,"
Mesos":null,"Eureka":null,"ECS":null,"Rancher":null,"DynamoDB":null}"
time="2017-10-18T22:02:29Z" level=info msg="Preparing server http &{Network: Address::80 TLS:<nil> Redirect:<nil> Auth:<nil> WhitelistSourceRange:[] Compress:false ProxyProtocol:<nil> Forwa
rdedHeaders:0xc420584e00} with readTimeout=0s writeTimeout=0s idleTimeout=3m0s"
time="2017-10-18T22:02:29Z" level=info msg="Starting server on :80"
time="2017-10-18T22:02:29Z" level=info msg="Starting provider *docker.Provider {"Watch":true,"Filename":"","Constraints":null,"Trace":false,"DebugLogGeneratedTemplate":false,"Endpoint":"uni
x:///var/run/docker.sock","Domain":"whakldman01d.thewarehousegroup.net","TLS":null,"ExposedByDefault":true,"UseBindPortIP":false,"SwarmMode":true}"
time="2017-10-18T22:02:29Z" level=info msg="Starting provider *web.Provider {"Address":":8080","CertFile":"","KeyFile":"","ReadOnly":false,"Statistics":null,"Metrics":null,"Path":"","Auth":
null,"Debug":false,"CurrentConfigurations":{},"Stats":{"Uptime":"2017-10-18T22:02:29.061284825Z","Pid":1,"ResponseCounts":{},"TotalResponseCounts":{},"TotalResponseTime":"0001-01-01T00:00:0
0Z"},"StatsRecorder":null}"
time="2017-10-18T22:02:29Z" level=debug msg="Provider connection established with docker 17.06.2-ce (API 1.30)"
time="2017-10-18T22:02:30Z" level=debug msg="Filtering container without port and no traefik.port label traefik_traefik.1"
time="2017-10-18T22:02:30Z" level=debug msg="Configuration received from provider docker: {}"
time="2017-10-18T22:02:30Z" level=debug msg="Last docker config received more than %!s(flaeg.Duration=2000000000), OK"
time="2017-10-18T22:02:30Z" level=info msg="Server configuration reloaded on :80"
time="2017-10-19T01:09:46Z" level=debug msg="Creating frontend frontend-Path-solr-update"
time="2017-10-19T01:09:46Z" level=debug msg="Wiring frontend frontend-Path-solr-update to entryPoint http"
time="2017-10-19T01:09:46Z" level=debug msg="Creating route route-frontend-Path-solr-update Path:/solr-update"
time="2017-10-19T01:09:46Z" level=debug msg="Creating backend backend-solr-update"
time="2017-10-19T01:09:46Z" level=debug msg="Creating load-balancer wrr"
time="2017-10-19T01:09:46Z" level=debug msg="Creating server server-solr-update_update-service-1 at http://<IP_ADDRESS>:8092 with weight 0"
time="2017-10-19T01:09:46Z" level=info msg="Server configuration reloaded on :80"
time="2017-10-19T01:10:01Z" level=debug msg="Filtering container without port and no traefik.port label traefik_traefik.1"
time="2017-10-19T01:10:02Z" level=debug msg="Validation of load balancer method for backend backend-image-cache failed: invalid load-balancing method ''. Using default method wrr."
time="2017-10-19T01:10:02Z" level=debug msg="Validation of load balancer method for backend backend-portainer failed: invalid load-balancing method ''. Using default method wrr."
time="2017-10-19T01:10:02Z" level=debug msg="Validation of load balancer method for backend backend-solr-update failed: invalid load-balancing method ''. Using default method wrr."
time="2017-10-19T01:10:02Z" level=debug msg="Configuration received from provider docker: {"backends":{"backend-image-cache":{"servers":{"server-image-cache_imagecache-1":{"url":"http://10.
0.0.7:8080","weight":0},"server-image-cache_imagecache-2":{"url":"http://<IP_ADDRESS>:8080","weight":0}},"loadBalancer":{"method":"wrr"}},"backend-portainer":{"servers":{"server-portainer_porta
iner-1":{"url":"http://<IP_ADDRESS>:9000","weight":0}},"loadBalancer":{"method":"wrr"}},"backend-solr-update":{"servers":{"server-solr-update_update-service-1":{"url":"http://<IP_ADDRESS>:8092","w
eight":0}},"loadBalancer":{"method":"wrr"}}},"frontends":{"frontend-Host-portainer-dev-thewarehousegroup-net":{"entryPoints":["http"],"backend":"backend-portainer","routes":{"route-frontend
-Host-portainer-dev-thewarehousegroup-net":{"rule":"Host:portainer-dev.thewarehousegroup.net"}},"passHostHeader":true,"priority":0,"basicAuth":[],"headers":{}},"frontend-Path-productImage":
{"entryPoints":["http"],"backend":"backend-image-cache","routes":{"route-frontend-Path-productImage":{"rule":"Path:/productImage"}},"passHostHeader":true,"priority":0,"basicAuth":[],"header
s":{}},"frontend-Path-solr-update":{"entryPoints":["http"],"backend":"backend-solr-update","routes":{"route-frontend-Path-solr-update":{"rule":"Path:/solr-update"}},"passHostHeader":true,"p
riority":0,"basicAuth":[],"headers":{}}}}"

This was solved by using PathPrefix, instead of Prefix.
I couldnt find documentation describing the 2?
e.g.
        - "traefik.port=8092"
        - "traefik.docker.network=proxy"
        - "traefix.protocol=http"
        - "traefik.tags=solr-update"
        - "traefik.backend=solr-update"
        - "traefik.frontend.rule=PathPrefix:/solr-update"


micro-optimization offsetGet($id)

I was going to suggest in offsetGet to skip the is_object() check for a micro-optimization.
(Xdebug profiler showed enough speed-gain, so that pimple ended up below
Composer\Autoload\ClassLoader->findFileWithExtension)
// $isFactory = is_object($this->values[$id]) && method_exists($this->values[$id], '__invoke');
   $isFactory = method_exists($this->values[$id], '__invoke');

However in version 2 i see a whole range of new checks, have you speed tested these?

The method_exists function trigger all registered autoloader if the first parameter is a string.
Thats would be bad for the performance. Sorry for my english.


Image uploading for A List Apart

Hi, folks. Posting here because we all notice GitHub posts. Feel free to respond privately via email. I have a question:
What’s the procedure to upload images for an A List Apart article? I know it’s not done in ExpressionEngine. I believe it may be done via SFTP?
For example, an article Brendan Gregory and I are prepping has 14 screenshots. How do we get them into the system, and is there a specific place to put them?
Again, feel free to send URL, password, user name, etc. via private email to jeffrey at z dot com.
Thanks!
z

Solved and closed.


Setters for hourMin, hourMax and stepMinute do not work

Hi,
First of all thanks for your work, looks very useful for me!
Second I'm trying do set the above fields dynamically (using 0.9.5), after the datetimepicker had been initialised and before it appears using:
$(params[0]).datetimepicker("option", "hourMin", 8);
$(params[0]).datetimepicker("option", "hourMax", 22);
$(params[0]).datetimepicker("option", "stepMinute", 15);
with no luck. If I pass this options when datepicker is initialised it works.
Tried the dev branch rev b53bf326f4fa34f57bf2 - same thing.

stepMinute does not work for me either

Hey guys, looks like settings' order is important. When I put stepMinute setting to the end like this (in CoffeeScript):
$(".datetime").datetimepicker(
dateFormat: 'M d, yy',
showOtherMonths: true,
selectOtherMonths: true,
showButtonPanel: false,
numberOfMonths: 2,
ampm: true,
timeFormat: 'hh:mm TT',
hourGrid: 2,
minuteGrid: 10,
stepHour: 1,
stepMinute: 5
)
... then it does not work. But when I put it to the beginning, it works.


Add coding style guide

Description of change
This adds a coding style guide.
Checklist

[ ] Has a new newsfragment been created? Check changelog/README.rst for instructions
[ ] Have any relevant search models been updated?
[ ] Have any relevant fixtures (fixtures/test_data.yaml) been updated?
[ ] Have any relevant select-/prefetch-related field lists in the views and search apps been updated?
[ ] Has the admin site been updated (for new models, fields etc.)?
[ ] Has the README been updated (if needed)?

Closes #1124


Cricbuzz

Description

Added a web scraper to scrape cricbuzz

Resolves Feature Request #438
Checklist

Before submitting this pull request, kindly verify that the ensuing checkpoints have been reached.

[x] Have you adhered to the repository's defined coding convention rules?
[x] Have you updated the 'documentation.md' file with the method/function documentation?
[x] Have you sent a message along with the result or response?
[x] Have you used the try-catch technique?
[x] Has the method/class been added to the documentation (md file)?

Screenshots

Additional Notes/Comments
I have checked the code multiple times and tried different edge cases that came to my mind if there is anything that seems weird or code bugs or anything that is not a good practice let me know I'll make changes

I certify that I have carried out the relevant checks and provided the requisite screenshot for validation by submitting this pull request.
I appreciate your contribution.

Great work @mukund1606 !!
Do not forget to

Share your contribution on socials(twitter mainly), tag us and Clueless 🫂
Give this repository a star ✨
Follow Clueless Community on GitHub ✅


feat: make delete product feature more accessible

What
This PR focuses on making the delete product feature more accessible.
Screenshot
https://github.com/openfoodfacts/smooth-app/assets/53305380/81c2bc19-ffe1-4a13-a2a6-744c7a57cf16
Fixes bug(s)
#4153

Codecov Report

Merging #4201 (0c8bcf0) into develop (38b2b8a) will decrease coverage by 0.03%.
The diff coverage is 0.00%.

@@             Coverage Diff             @@
##           develop    #4201      +/-   ##
===========================================
- Coverage    10.88%   10.86%   -0.03%
===========================================
  Files          277      277
  Lines        13600    13631      +31
===========================================
  Hits          1481     1481
- Misses       12119    12150      +31

Impacted Files
Coverage Δ

...pp/lib/pages/product/common/product_list_page.dart
0.00% <0.00%> (ø)

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

Cool will do the needful!

@g123k I have done the needful changes please review it once! :)


TFS Should Probably be Azure DevOps Server

Tons of references to TFS in this, and since Server is now out, probably should get updated. I can take a look at the amount of work if it has not been looked at yet.

Thanks for the offer. We are updating the current labs to Azure DevOps Server and we will also have the accompanying VM upgraded.


Improve build time, reduce connections between files etc.

The goal in the title is a nice thought, but CI is saying build on this took a bit longer than my pr...

@Dregu i didn't actually test the full rebuild time, the main goal was to reduce the connections, so when you change one file you don't need to rebuild 65 other


DPI scaling (on linux but possibily OSX/Windows as well)

I have a 4k monitor and the demo is absolutely unusable since it doesn't scale with X's DPI.
Here's how it looks for me maximized:

This is not an issue of the bindings, but the library itself. See https://github.com/vurtun/nuklear/issues/123 for insight.

@Kernle32DLL @OneOfOne I think this issue is about examples in this bindings project, as it uses pixels rather than points. So I'm not closing as I would like to convert them into points one day.


Configurable default units

See https://github.com/jsstyles/jss/issues/271
SUMMARY

Delete numericProps.js.
Add defaultProps.js (a map of props to default units).
Change index.js to lookup defaults.
Change index.js to use the options parameter differently.
Added tests for ms and % units.
Added test for configured properties.
Changed tests using the property name 'property' to a real property ('background-size').

BREAKING CHANGES
There are at least two breaking changes; they don't much affect real life, but it's worth knowing what they are:

Setting the options object to something like {unit: 'em'} no longer changes all units.
Properties containing 'origin' (except for mask-origin) now get % as a default unit.

We could change the code to avoid (1) and (2), but in the case of (1), the options API becomes logically less predictable and less understandable if we make 'unit' into a super setting that overrides all others. In the case of (2), keeping to px makes the default setting less useful in general (I would argue).

Actually, it just occurred to me that this will change any value that can take a px unit to px. That means properties like line-height will default to px instead of being numeric. I think it'd be best if I edit the list so that doesn't happen.

Yeah, numeric props by default should stay numeric.  This is pretty much the list we have right now, except of the last one recently added property.

Oh however this list could be shortened because it needs to contain only props which would accept also px, there are some which accept numerics only anyways.

New map appears below. There are 4 properties are set to 'ms', 4 are set to '%', and the rest are 'px'. No properties that will accept a plain numeric value appear in the map below - only those which require a unit.
The code that generates the map is here (gist).
/**
 * Generated jss-default-unit CSS property units
 * @object
 */
export default {
  'background-position-x': 'px',
  'background-position-y': 'px',
  'background-size': 'px',
  border: 'px',
  'border-bottom': 'px',
  'border-bottom-left-radius': 'px',
  'border-bottom-right-radius': 'px',
  'border-bottom-width': 'px',
  'border-left': 'px',
  'border-left-width': 'px',
  'border-radius': 'px',
  'border-right': 'px',
  'border-right-width': 'px',
  'border-spacing': 'px',
  'border-top': 'px',
  'border-top-left-radius': 'px',
  'border-top-right-radius': 'px',
  'border-top-width': 'px',
  'border-width': 'px',
  bottom: 'px',
  'column-gap': 'px',
  'column-rule': 'px',
  'column-rule-width': 'px',
  'column-width': 'px',
  'flex-basis': 'px',
  'font-size': 'px',
  height: 'px',
  left: 'px',
  'letter-spacing': 'px',
  margin: 'px',
  'margin-bottom': 'px',
  'margin-left': 'px',
  'margin-right': 'px',
  'margin-top': 'px',
  'max-height': 'px',
  'max-width': 'px',
  'min-height': 'px',
  'min-width': 'px',
  motion: 'px',
  'motion-offset': 'px',
  outline: 'px',
  'outline-offset': 'px',
  'outline-width': 'px',
  padding: 'px',
  'padding-bottom': 'px',
  'padding-left': 'px',
  'padding-right': 'px',
  'padding-top': 'px',
  perspective: 'px',
  right: 'px',
  'shape-margin': 'px',
  size: 'px',
  'text-indent': 'px',
  top: 'px',
  'vertical-align': 'px',
  'border-after-width': 'px',
  'border-before-width': 'px',
  'border-end-width': 'px',
  'border-horizontal-spacing': 'px',
  'border-start-width': 'px',
  'border-vertical-spacing': 'px',
  'font-size-delta': 'px',
  'logical-height': 'px',
  'logical-width': 'px',
  'margin-after': 'px',
  'margin-before': 'px',
  'margin-end': 'px',
  'margin-start': 'px',
  'mask-position-x': 'px',
  'mask-position-y': 'px',
  'mask-size': 'px',
  'max-logical-height': 'px',
  'max-logical-width': 'px',
  'min-logical-height': 'px',
  'min-logical-width': 'px',
  'padding-after': 'px',
  'padding-before': 'px',
  'padding-end': 'px',
  'padding-start': 'px',
  'perspective-origin-x': '%',
  'perspective-origin-y': '%',
  'text-stroke': 'px',
  'text-stroke-width': 'px',
  'transform-origin-x': '%',
  'transform-origin-y': '%',
  'transform-origin-z': 'px',
  width: 'px',
  'word-spacing': 'px',
  'animation-delay': 'ms',
  'animation-duration': 'ms',
  'transition-delay': 'ms',
  'transition-duration': 'ms'
}

We can generate this map at runtime once and cache, so there is literally no perf overhead. However we would need a static map for ssr.

I did it for vendor prefixer plugin same way.

My code works by iterating the CSS properties of a DOM node to set them to various value types and then check whether Chrome permits the assigned type. Sadly, other vendors' DOM APIs don't allow that. In FireFox HTMLElement.style is neither iterable nor serializable (CSS2Properties instance).
Since some vendors are unwilling to allow iterating the properties, I think it'd be best to use a static list instead of trying to hack our way to a complete list in every browser.
What do you think?

https://github.com/jsstyles/css-vendor/blob/master/src/supported-property.js#L20

Actually it is optional there, so i don't even know if the cache is prefilled in firefox, forgot the details of implementation.

I used .getComputedStyle, but results are inconsistent among browsers (Chome/FF). The core cases are the same, but some shorthand properties (e.g., border) are not. This'd result in our assigning different default units in different browsers. That would be just about impossible to anticipate and probably very frustrating to debug.
Chrome is very well behaved. It does the right thing in every case. FireFox doesn't. I still recommend including the list generated by Chrome.

yep

All set.

Let me know if there are further issues with this PR that I should be working on.

Just wanted to merge it, but there is a conflict

can you resolve or should I?

Okay, but once merged, ignoreProps.js needs to be deleted. For some reason, its being deleted in my fork manifests as a merge conflict, so I un-deleted it, as it were.